Technical  Report  No.  18 
October,  1979 


Approved  for  public  release;  distribution  unliaited. 
Reproduction  in  whole  or  in  part  is  pensitted  for 
an)r  purpose  of  the  United  States  Goverment. 


This  research  was  sponsored  by  the  Personnel  and 
Training  Research  Prograiss,  Psychological  Sciences 
Division,  Office  of  Naval  Research,  under  Contract 
No.  N0001478C0025,  Contract  Authority  Identification 
Niaiber  NR  ISO-412. 


Unities  in  Inductive  ReasMing 


Robert  J.  Sternberg  cad  Michael  K.  Gardner 


Departnent  of  Psychology 
Yale  University 
New  Haven,  Connecticut  06520 


UNCUSSIFIED _ 

^CCuniTV  CL<fcS5iriCATlOK  QF  TWIS  (Whmn  Dmtm  Knimtmd) 

f  REPORT  DOCUMENTATION  PAGE 


I  1.  nC^OftT  NUMBER 


|4-  yiTLt  Matt0) 


/  (}H 


^nities  in  Inductive  Reasoning^ 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 
1  RECI^lEN'TSCATAkOC  NUMBEM 


».  TVBE 

Periodic]  Technical  /ep»t,  /KftI  vy 
Sepgo  - 

B.  FENFONMINO  ORG.  REBOMMUilBCn 


Reseat 


jpp/)i4: 


tA-AUZMOBUI _ I  _ A  CftuTaV*-^  ^ 

j  Robert  J.^Stemberg  Michael  K.^ardner  ^  ^ ^ 

>.  beneommino  omganization  name  and  addhess  io.  feooeam  element,  bboject,  t 

/  ANEA  A  WORK  UNIT  NUMBERS 

Department  of  Psychology  '  —  611StN;  _ _ _ 

Yale  University  /</  X  )  Mr94^4\  /RR‘^(]42C(i>49Pl| 

New  Haven.  Connecticut  06520 _ ^  NR  15ftM1277>^  -j — 

11.  CONTROLLING  OFFICE  NAME  and  ADDRESS  _ U-  RERQI^  '  J- 

Personnel  and  Training  Research  Programs  jj  j  1  Oct  79  7 _ 

Office  of  Naval  Research  (Code  458)  -t».  humber  of  rages 

Arlington.  Virginia  22217 _ '  ifi _ 

monitoring  AGENCY  NAME  *  AODRESSfl/ Irom  ContfoWng  OtUf)  18.  SCCU^lTV  CL  ASS.  f»l  report; 


10.  PROORAM  CLCMrNt.  ^MOJCCT.  TASK 
AMCA  0  WORK  UNIT  NUMBCNS 


U.  RERORT  DA«  Ly  "  JL 


^TT.  'Humber  of  rages 


Unclassified 


ISa.  DECLASSIFICATION  DOWNGRADING 
SCHEDULE 


I  IS.  DISTRIBUTION  STATEMENT  (et  thla  Report; 


Approved  for  public  release;  distribution  unlimited 


I  IT.  distribution  statement  (al  ih*  •btffcl  mittnd  In  Blonk  30,  II  dllltrtnl  tnm  Kdpart) 


IS.  supplementary  NOTES 


Portions  of  this  paper  were  presented  at  the  Annual  Meeting  of  the  Societv 
for  Mathematical  Psychology,  Providence,  August,  1979, 


I  IS.  key  words  (Ctnilnut  on  r*v«r*«  tld»  II  nwtatr  and  Iddnllly  by  biccb  Humbmt) 


Inductive  reasoning,  component,  analogies,  series  completions,  classification] 


so.  ABSTRACT  fCAtiMmi*  on  rcoArM  Aid*  It  n*e***a>r  And  Idtillly  by  Sloe*  immiSaO 

Two  experiments  sought  to  discover  sources  of  communalities  in  performance 
on  three  inductive  reasoning  tasks:  analogies,  series  completions,  and 
classifications.  In  Experiment  1,  30  subjects  completed  an  untimed  pencil- 
and-paper  test  in  which  they  were  asked  to  solve  90  induction  items,  equally 
divided  among  the  three  kinds  of  induction  items  noted  above.  The  subjects' 
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were  highly  correlated,  suggestine  the  possibility  of  a  common  model  of  re¬ 
sponse  choice  across  tasks.  Moreover,  a  single  exponential  model  of  response 
choice  provided  a  good  fit  to  each  data  set.  The  single  parameter  estimate 
for  this  model  was  roughly  comparable  across  tasks.  In  Experiment  2,  36  sub¬ 
jects  completed  a  timed  tachistoscopic  test  in  which  they,  too,  were  asked 
to  solve  90  induction  items,  equally  divided  among  the  three  kinds  of  induc¬ 
tion  items  noted  above.  The  subjects'  task  was  to  choose  the  better  of  two 
response  options  as  a  completion  for  each  particular  item.  Data  sets  for  the 
three  tasks  were  again  highly  intercorrelated,  suggesting  the  possibility  of  a 
common  model  of  real-time  information  processing  across  tasks.  Moreover,  a 
single  linear  model  of  response  times  provided  a  good  fit  to  each  data  set. 
Three  of  four  parameter  estimates  were  roughly  comparable  across  tasks.  It 
was  concluded  that  a  common  model  of  response  choice  and  of  information  proces 
sing  can  account  for  at  least  some  of  the  previously  observed  relationships 
in  performance  across  induction  tasks.  The  implications  of  these  findings  for 
psychometric  and  information-processing  accounts  of  induction  and  intelligence 
are  discussed. 
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Abstract 

Two  experiaents  sought  to  discover  sources  of  communal ities  in  perfoxnance 
on  three  inductive  reasoning  tasks:  analogies,  series  completions,  and  classi¬ 
fications.  In  Experiment  1,  30  subjects  conpleted  an  untimed  pencil-and-paper 
test  in  which  they  were  asked  to  solve  90  induction  items,  equally  divided 
among  the  three  kinds  of  induction  items  noted  above.  The  subjects'  task  was 
to  rank-order  four  response  options  in  terms  of  their  goodness  of  fit  as  comple¬ 
tions  for  each  particular  item.  Data  sets  for  the  three  tasks  were  highly 
intercorrelated,  suggesting  the  possibility  of  a  common  model  of  response  choice 
across  tasks.  Moreover,  a  single  exponential  model  of  response  choice  provided 
a  good  fit  to  each  data  set.  The  single  parameter  estimate  for  this  model  was 
roughly  comparable  across  tasks.  In  Experiment  2,  36  subjects  completed  a  timed 
tachistoscopic  test  in  which  they,  too,  were  asked  to  solve  90  induction  items, 
equally  divided  among  the  three  kinds  of  induction  items  noted  above.’  The  sub¬ 
jects'  task  was  to  choose  the  better  of  two  response  options  as  a  completion  for 
each  particular  item.  Data  sets  for  the  three  tasks  were  again  highly  inter¬ 
correlated,  suggesting  the  possibility  of  a  common  model  of  real-time  information 
processing  across  tasks.  Moreover,  a  single  linear  model  of  response  times  pro¬ 
vided  a  good  fit  to  each  dat»  set.  Three  of  four  parameter  estimates  for  this  model 
were  roughly  comparable  across  tasks.^  It  was  concluded  that  a  common  model  of 
response  choice  and  of  information  processing  can  account  for  at  least  some  of 
the  previously  observed  relationships  in  performance  across  induction  tasks.  The 
implications  of  these  findings  for  psychometric  and  information-processing  accounts 
of  induction  and  intelligence  are  discussed. 
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Unities  in  Inductive  Reasoning 

Inductive  reasoning  requires  an  individual  to  reason  froa  part  to  whole,  or 
froB  particular  to  general  (Webster’s  New  Collegiate  Dictionary,  1976) .  Inductive 
reasoning  problems  can  be  of  various  kinds.  One  of  the  nost  interesting  kinds  is 
that  which  Greeno  (1978)  refers  to  as  problems  of  inducing  structure.  Problems 
of  this  kind  include  analogies  (e.g.,  LAWYER  is  to  CLIENT  as  DOCTOR  is  to  (a) 

PATIENT,  (b)  MEDICINE),  series  completions  (e.g..  Which  word  should  come  next 
in  the  following  series?  PENNY,  NICKEL,  DIME,  (a)  COIN,  (b)  QUARTER),  and  classi¬ 
fications  (e.g..  Which  of  the  two  words  at  the  right  fits  better  with  the  three 
words  at  the  left?  CAT,  MOUSE,  LION,  (a)  SQUIRREL,  (b)  EAGLE).  These  problems 
are  of  particular  interest  because  they  have  played  a  key  role  in  both  the  psycho¬ 
metric  and  information-processing  literatures  on  reasoning  and  intelligence,  as  well 
as  in  the  recent  literature  attempting  to  integrate  the  psychometric  and  information- 
processing  approaches. 

In  the  psychometric  literature,  problems  of  inducing  structure  have  been  con¬ 
sidered  important  because  they  provide  particularly  good  measures  of  general  intel¬ 
ligence,  or  £.  Factor  analyses  of  multiple  ability  tests  often  yield  a  "general 
factor,"  or  single  source  of  individual  differences,  that  permeates  the  entire  range 
of  tests  (Spearman,  1927).  Even  when  this  general  factor  does  not  appear  froa  an 
immediate  factoring  of  the  tests  (Thurstone,  1938),  it  often  appears  when  factors 
that  do  not  include  a  general  factor  are  themselves  factored  (Humphreys,  1962). 

Hhen  correlations  are  computed  between  individual  tests  and  the  general  factor, 
problems  of  inducing  structure  usually  show  some  of  the  highest  correlations. 
Moreover,  scores  on  these  problems  are  highly  correlated  among  themselves  (see 
Cattell,  1971;  Horn,  1968). 
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These  results  suggest  that  some  common  source  of  Individual  differences  underlies 
performance  on  these  various  kinds  of  problems.  The  Importance  of  this  common 
source  of  Individual  differences  to  psychometric  theory  Is  shown  by  the  fact 
that  the  concept  of  has  played  a  prominent  part  In  several  major  psychometric 
theories  of  Intelligence  (e.g.,  Burt,  1940;  Hem  S  Cattell,  1966;  Humphreys, 

1962;  Spearman,  1927;  Vernon,  1971),  and  by  the  fact  that  the  problems  of  In¬ 
ducing  structure  are  such  good  measures  of  £  that  they  are  found  on  an  over¬ 
whelming  majority  of  psychometric  intelligence  tests. 

In  the  Information-processing  literature,  problems  of  inducing  structure 
have  been  considered  important  because  the  underlying  processes  involved  in  solving 
these  problems  seem  to  be  so  basic  to  human  cognition,  both  in  laboratory  and 
real>world  settings.  These  problems  have  served  as  the  bases  for  a  number  of 
task  analyses.  Several  computer  programs,  for  example,  have  been  devoted  ex¬ 
clusively  to  the  solution  of  analogies  (Evans,  1968;  Reltman,  196S)  or  series 
coBQiletions  (Simon  6  Kotovsky,  1963),  and  other  computer  problems  have  dealt 
with  analogies  or  series  completions,  among  other  kinds  of  problems  (Williams, 

1972;  Winston,  1974).  Analogy  problems  have  been  studied  experimentally  in  a 
number  of  investigations  with  human  subjects  (e.g.,  Mulholland,  Pellegrino, 

I  Glaser,  in  press;  Sternberg,  1977a,  1977b;  Whitely  8  Barnes,  1979),  as  have 
series  completions  (e.g.,  Holzman,  Glaser,  |  Pellegrino,  1976;  Kotovsky  8  Simon, 

1973).  We  are  unaware  of  any  previously  published  information-processing  analy¬ 
ses  of  the  classification  task,  although  Pellegrino  and  his  colleagues  are  cur¬ 
rently  studying  this  task  (Pellegrino,  Note  1),  and  the  literature  on  concepts  and  thei 
sttainment  can  be  viewed  as  indirectly  studying  this  sort  of  task  (e.g.,  Bruner, 
Goodnow,  I  Austin,  19S6;  Rosch,  1978). 

Several  information-processing  psychologists  have  claimed  that  the  high 
intercorrelations  obtained  between  subjects'  performances  on  various  kinds  of 
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probleas  of  inducing  structure  are  attributable  to  conssunalities  in  inforaation 
processing  across  the  various  problem  types  (e.g.,  Greeno.  1978;  Pellegrino  8 
Glaser,  1979,  in  press;  Sternberg,  1977b,  1979).  The  investigations  reported 
here  represent  what  we  believe  is  a  first  attempt  to  demonstrate  these  commu- 
nalities  in  information  processing  experimentally;  To  the  extent  that  the 
investigations  are  successful,  they  offer  the  promise  of  illuminating  at  least 
some  sources  of  the  mysterious  g  factor  that  has  been  obtained  in  numerous 
psychometric  inquiries  into  the  nature  of  human  intelligence. 

TWo  experiments  were  conducted.  The  first  experiment  sought  to  demonstrate 
that  a  common  model  could  account  for  response  choices  in  the  solution  of  analo¬ 
gies,  series  completions,  and  classifications.  The  second  experiment  sought 
to  demonstrate  that  a  common  model  could  account  for  real-time  information 
processing  in  the  solution  of  these  three  kinds  of  problems. 

EXPERIMENT  1 

Our  proposed  model  of  response  choice  in  inductive  reasoning  of  the  sort 
required  by  analogies,  series  completions,  and  classifications,  is  an  extension 
of  the  Rumelhart-Abrahamson  (1973)  model  of  response  choice  in  analogical  reason¬ 
ing.  Rumelhart  and  Abrahamson  defined  reasoning  as  the  set  of  thought  processes 
In  information  retrieval  that  operates  upon  the  structure,  as  opposed  to  the 
content,  of  organized  memory.  If  information  retrieval  depends  upon  specific 
content  stored  in  memory,  then  retrieval  is  referred  to  as  "remembering."  If, 
however,  information  retrieval  depends  upon  the  form  of  one  or  more  relationships 
among  words,  then  it  is  referred  to  as  "reasoning." 

Pursuing  this  definition  of  reasoning,  Rumelhart  and  Abrahamson  claimed  that 
probably  the  simplest  possible  reasoning  task  is  the  judgment  of  the  similarity 
or  dissimilarity  between  concepts.  They  assumed  that  the  degree  of  similarity 
between  concepts  is  not  directly  stored  as  such,  but  is  instead  derived  from 
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previously  existing  memory  structures.  Judged  siailarity  between  concepts  is 
•  sieple  function  of  the  "psychological  distance"  between  these  concepts  in  the 
Moory  structure.  The  nature  of  this  function  and  of  the  menory  structure  upon 
which  it  operates  is  clarified  by  their  assumptions  (after  Henley,  1969)  that 
(a)  the  memory  structure  may  be  represented  as  a  multidimensional  Euclidean  space 
and  that  (b)  judged  similarity  is  inversely  related  to  distance  in  this  space. 

On  this  view,  analogical  reasoning  may  be  considered  a  kind  of  siailarity  Judpaenc 
between  concepts,  one  .  in  which  not  only  the  magnitude  of  the  distance  but  also 
the  direction  is  of  importance.  For  example,  we  would  ordinarily  interpret  the 
analogy  problem,  A  :  B  ::  C  :  X^,  as  stating  that  A  is  similar  to  B  in  exactly 
the  same  way  that  C  is  similar  to  X^.  According  to  the  assumptions  outlined 
above,  we  might  reinterpret  this  analogy  as  saying  that  the  directed  or  vector 
distance  between  A  and  ^  is  exactly  the  same  as  the  vector  distance  between  £ 
and  X^.  The  analogy  is  imprecise  to  the  extent  to  which  the  two  vectoy  distances 
are  not  equal. 

Rumelhart  and  Abrahamson  formalized  the  assumptions  of  their  model  by  stating 
that  given  an  analogy  problem  of  the  fora  A  :  B  ::  C  :  (Xj,  X^,  ...,  X^),  It  Is 
assumed  that 

I  Al.  Corresponding  to  each  element  of  the  analogy  problem  there  is  a  point 
In  an  m-diaensional  space.... 

A2.  For  any  analogy  problem  of  the  form  A  ;  B  : :  C  :  there  exists  a 


concept  I  such  that  A  :  B  ::  C  :  I  and  an  ideal  analogy  point,  denoted  £  such 
located  the  same  vector  distance  from  C  as  B  is  from  A.  The  coordi¬ 


nates  of  £  are  given  by  the  ordered  sequence  (c.  ♦  b,  -  a,},  J  ■  1,  m. 

"1  “1  ”i  “ 

AJ,  The  probability  that  any  given  alternative  X^  is  chosen  as  the  best 

[analogy  solution  from  the  set  of  alternatives  X,,  ...,  X  is  a  nonotonic  de- 
;  I  n 

creasing  function  of  the  absolute  value  of  the  distance  between  the  point 
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land  the  point  I^,  denoted  *  £|«  (p.  4) 

The  first  assumption  simply  states  that  the  concepts  corresponding  to  the 
elements  of  the  analogy  exist  and  are  locatable  within  the  m-dimensional  space 
representing  the  memory  structure.  The  second  assumption  states  that  an  ideal 
solution  point  also  exists  within  the  memory  structure,  and  that  this  point 
also  represents  a  concept;  it  is  quite  likely  that  no  real-world  concept  will 
correspond  to  this  ideal  point,  so  that  the  ideal  point  may  not  have  a  named 
concept  in  the  English  (or  any  other)  language.  The  third  assumption  states  that 
the  selection  of  a  correct  answer  option  is  governed  by  the  distance  between 
the  various  answer  options  and  the  ideal  point,  such  that  less  distant  answer 
options  are  selected  more  often  than  are  more  distant  answer  options. 

These  assumptions  permit  ordinal  predictions  about  the  goodness  of  the 
various  answer  options,  but  do  not  permit  quantitative  predictions.  In  order 
to  make  quantitative  predictions  of  response  choices,  Rumelhart  and  Abrahamson 

t 

made  assumption  3  more  specific,  and  added  two  more  assumptions: 

3'.  The  probability  that  any  given  alternative  is  chosen  from  the  set 

n 

of  alternatives  Xj,...,X^  is  given  by  Pr(X^(Xj,...,X^)  •  ■  v(d^)  /[I  v(d^)], 

where  d^  *  -  I^|  denotes  the  absolute  value  of  the  distance  between  and  I, 

and  vC  )  is  a  monotonically  decreasing  function  of  its  argument. 

4.  v(X)  «  exp(-aX),  where  X  and  o  are  positive  numbers. 

5.  We  assume  that  the  subjects  rank  a  set  of  alternatives  by  first  choosing 
the  Rank  1  element  according  to  3'  and,  then,  of  the  remaining  alternatives, 
deciding  which  is  superior  by  application  of  3*  to  the  remaining  set  and  assign¬ 
ing  that  Rank  2.  This  procedure  is  assumed  to  continue  until  all  alternatives 
are  ranked,  (pp.  8-9) 

The  more  specific  version  of  assumption  3  (labeled  3')  is  an  Adaptation  of 
Luce's  (1959)  choice  rule  to  the  choice  situation  in  the  analogy.  Assumption  4 
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further  specifies  that  the  monotone  decrease  in  the  likelihood  of  choosing  a  par¬ 
ticular  answer  option  as  best  follows  an  exponential  decay  function  with  increasing 
distance  from  the  ideal  point.  The  model  of  response  choice  therefore  requires 
a  single  parameter,  representing  the  slope  of  the  function.  Rumelhart  and 
Abrahamson  actually  had  their  subjects  rank-order  answer  options.  The  investi¬ 
gators  predicted  the  full  set  of  rank  orderings  by  assuming  (in  assumption  S)  that 
once  subjects  had  ranked  one  or  more  options,  they  would  rank  the  remaining  options 
in  exactly  the  same  way  that  they  had  ranked  the  previous  options,  except  that  they 
would  ignore  the  previously  ranked  options  in  making  their  further  rankings. 

1 

Rumelhart  and  Abrahamson  (1973)  carried  out  three  ingenious  experiments  to 
test  their  model  of  analogical  reasoning,  using  Henley's  (1969)  mammal-name  space 
of  three  dimensions  (size,  ferocity,  humanness)  as  a  basis  for  representing  informatior 
about  the  mammals.  The  first  experiment  set  out  to  show  that  subjects  rank-order 
options  in  accordance  with  the  assumptions  outlined  above.  Subjects  rank-ordered 
options  in  30  analogy  problems  using  mammal  names  as  analogy  terms.  The  second  experi¬ 
ment  set  out  to  show  that  the  response  distribution  should  depend  upon  the  ideal  solu¬ 
tion  point  and  upon  the  alternative  set,  but  not  upon  the  terms  of  the  particular  analc 
gy  problem.  Twelve  analogy  pairs  were  constructed  that  had  the  same  ideal  points  withi 
a  tolerance  of  .12  scaled  units  (roughly  the  distance  between  a  lion  and  a  tiger),  and 
in  which  the  ith  closest  alternative  for  one  set  was  at  about  the  same  distance  from  th 
ideal  point  as  the  £th  closest  alternative  for  the  other  set.  There  were  no  overlappir 
analogy  terms  across  paired  items,  however.  The  third  experiment  set  out  to  show  that 
if  the  ideal  point  of  an  analogy  is  given  a  name  corresponding  to  an  imaginary  mammal, 
subjects  will  use  the  newly  named  mammal  in  the  same  way  in  solving  analogies  that 
they  use  the  names  of  actual  mammals.  Subjects  were  taught  the  meanings  of  three 
imaginary  mamals,  and  were  then  asked  to  perform  some  tasks  that  tested  their  under¬ 
standing  of  the  properties  of  these  imaginary  mammals.  The  experiments  were  generally 
supportive  of  the  Rumelhart -Abrahamson  model,  and  the  results  led  the  authors  to 
conclude  that  at  least  for  those  portions  of  semantic  memory  that  are  representable 
ms  multidimensional  semantic  spaces,  the  proposed  model  of  analogical  reasoning 
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provides  a  good  account  of  response  choices. 

We  propose  a  modest  extension  of  the  Rumelhart-Abrahanson  model  so  that 
It  can  account  for  response  choices  in  series  completion  and  classification 
problems  as  well  as  in  analogy  problems.  Figure  1  shows  how  the  extended  model 
accounts  for  response  choices  in  each  of  the  three  types  of  problems. 

Insert  Figure  l  about  here 

Consider  an  analogy  problem  of  the  form,  A  ;  B  C  :  (Dj,  D2,  Dj,  D^),  e.g. , 
TIGER  ;  CHIMPANZEE  WOLF  :  (1.  RACCOON,  2.  CAMEL,  ’3.  MONKEY,  4.  LEOPARD),  where 
the  subject's  task  is  to  rank-order  the  answer  options  in  terms  of  how  well  their 
relation  to  WOLF  is  parallel  to  that  between  CHIMPANZEE  and  TIGER.  In  an  analogy 
problem  such  as  this  one,  the  subject  must  find  an  ideal  point,  I,  that  is  the 
same  vector  distance  from  WOLF  as  CHIMPANZEE  is  from  TIGER.  Having  found  this 
point,  the  subject  rank-orders  answer  options  according  to  their  overall  Euclidean 
distance  from  the  ideal  point.  The  probability  of  selecting  any  one  answer  option 
as  best  is  assumed  to  follow  an  exponential  decay  function,  with  probability  de¬ 
creasing  as  distance  from  the  ideal  point  increases.  The  same  selection  rule  is 
applied  in  rank-ordering  successive  options,  with  previously  selected  options 
removed  from  consideration. 

Consider  next  a  series  completion  problem  of  the  form,  A  :  B  :  (Cj,  C2,  C^,  C^), 
e.g.,  SQUIRREL  ;  CHIPMUNK  ;  (1.  RACCOON,  2.  HORSE,  3.  DOG,  4.  CAMEL),  where  the 
subject's  task  is  to  rank-order  the  answer  options  in  terms  of  how  well  they 
complete  the  series  carried  from  SQUIRREL  to  CHIPMUNK.  Here,  the  subject  must  find  • 
an  ideal  point,  £,  that  is  the  same  vector  distance  from  CHIPMUNK  as  CHIPMUNK  is  from 
SQUIRREL.  Note  that  the  difference  between  a  series  completion  problem  and  an  analo¬ 
gy  is  that  whereas  the  terms  of  an  analogy  form  a  parallelogram  (or  its  m-dinensional 
analogue)  in  the  multidimensional  space,  the  terns  of  a  series  completion  form  a 
line  segment  (or  its  m-dinensional  analogue)  in  the  space.  The  same  principle  would 

apply,  regardless  of  the  number  of  terms  in  the  item  stem.  Having  found  the  Ideal 
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point,  the  subject  rank-orders  answer  options  with  respect  to  the  ideal  point  in 
just  the  sane  way  that  he  or  she  would  in  an  analogy  problem. 

Consider  finally  a  classification  problem  of  the  form.  A,  B,  C,  (D^,  D2,  Dj,  D^), 
o.f..  ZEBRA,  GIRAFFE,  GOAT,  (1.  DOG,  2.  COK,  3.  MOUSE,  4.  DEER),  where  the  subject's 
task  is  to  rank-order  the  answer  options  in  terms  of  how  well  they  fit  with  the 
three  terms  in  the  item  stem.  In  this  type  of  problem,  the  subject  must  find  an 
ideal  point,  £,  that  represents  the  centroid  in  multidimensional  space  of  ZEBR\, 
GIRAFFE,  and  GOAT.  Having  found  this  point,  the  subject  rank-orders  the  answer 
options  according  to  their  overall  Euclidean  distance  from  the  ideal  point,  in 
just  the  same  was  as  he  or  she  would  for  analogies  or  series  completions.  Again, 
the  same  basic  principle  applies  without  regard  to  the  number  of  terms  in  the  item 
stem.  The  centroid  of  the  points  is  theorized  always  to  serve  as  the  ideal  point. 

In  Experiment  1,  subjects  were  presented  30  analogies,  30  series  completions, 
and  30  classifications  (in  an  order  counterbalanced  across  subjects).  The  subjects' 
task  was  to  rank-order  the  goodness  of  four  alternative  answer  options  in  terms  of 
their  appropriateness  as  completions  to  the  problem  stems.  The  task  was  untimed. 

Method 

Subjects 

Thirty  college-age  adults  from  the  New  Haven  area — 19  women  and  11  men — 
participated  in  the  experiment.  Subjects  received  either  pay  at  the  rate  of  $2.50 
per  hour,  credit  toward  fulfillment  of  an  introductory  psychology  course  require¬ 
ment  at  Yale,  or  some  combination  of  the  two. 

Materials 

Problems  of  all  three  types— analogies,  series  completions,  classifications— 
were  composed  of  mammal  names  from  the  set  multidimensional ly  scaled  by  Henley 
(1969).  There  were  30  problems  of  each  type,  and  each  drew  upon  the  set  of  30 
names  in  the  following  ways. 

Analogies  were  taken  from  Experiment  1  of  Rumelhart  and  Abrahamson  (1973).^ 
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All  30  analogy  problems  were  of  the  form,  A  :  B  ::  C  :  (Dj*  02*  ®5»  example, 

tiger  :  CHIMPANZEE  WOLF  ;  (1.  RACCOON,  2.  CAMEL,  3.  MONKEY.  4.  LEOPARD).^ 
Rumelhart  and  Abrahamson  constructed  their  analogy  stems  (A  :  B  ::  C)  by  sampling 
without  replacement  from  the  pool  of  30  mammal  names  until  all  of  the  terms 
were  exhausted,  and  then  by  replacing  the  entire  pool.  The  first  tern  sampled 
became  the  A  term  of  the  first  problem;  the  second  term  became  the  B  term  of  the 
first  problem;  the  third  term  became  the  C  term  of  the  first  problem;  the  fourth 
term  became  the  A  term  of  the  second  problem;  etc.  This  selection  procedure  con¬ 
tinued  until  30  unique  analogy  stems  were  formed.  At  this  point,  answer  options 
were  selected  with  the  following  constraints:  (a)  one  option  was  within  .5 
scaled  units  of  distance  from  the  ideal  point;  (b)  a  second  option  was  between 
,5  and  1.0  scaled  units  from  the  ideal  point;  (c)  a  third  option  was  between  1.0 
and  1.5  scaled  units  from  the  ideal  point;  (d)  a  fourth  option  was  more  than  1.5 
Scaled  units  from  the  ideal  point;  additionally,  answer  options  were  not  permitted 
to  overlap  with  mammal  names  in  the  analogy  stem.  If  any  of  these  constraints 
could  not  be  satisfied,  a  new  unique  stem  was  formed,  and  the  constraints  were 
again  applied  to  the  new  analogy.  This  process  was  repeated  until  30  acceptable 
analogies  had  been  constructed. 

Series  completion  problems  were  of  the  form,  A  :  B  ;  (C^,  C^,  C^,  C^),  for 
example,  SQUIRREL  :  CHIPMUNK  :  (1.  RACCOON,  2.  HORSE.  3.  DOG,  4.  CAMEL). ^  The 
series  completion  problems  were  generated  in  a  manner  that  was  similar  to  that 
used  for  the  analogy  problems.  All  possible  combinations  of  two  of  the  mammal 
terms  were  produced,  and  an  ideal  point  for  each  of  these  pairs  of  terms  was 
calculated.  This  procedure  yielded  a  total  of  870  possible  series  completion 
problems.  Problems  were  selected  from  this  set  at  random  until  30  acceptable 
Items  were  produced.  The  constraints  for  acceptability  were  that  (a)  the  ideal 
point  lie  within  the  (arbitrary)  boundaries  of  the  multidimensional  space  pro- 
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duced  by  Henley's  (1969)  scaling  and  that  (b)  four  suitable  answer  options  could 
be  selected  according  to  the  constraints  used  for  the  production  of  answer 
options  in  the  analogy  problems. 

Classification  problems  were  of  the  form,  A,  B,  C,  (D, ,  D.,  D_,  D,),  for 

12  3  4 

example,  ZEBRA,  GIRAFFE,  GOAT,  (1.  IKW,  2.  COW,  5.  MOUSE,  4.  DEER).^  Classifica¬ 
tion  problem  stems  were  sampled  from  all  possible  triplets  of  mammal  names  with 
geometric  perimeters  of  greater  than  1.5  scaled  units  of  distance,  but  less  than 
2,0  scaled  units.  The  perimeter  of  the  "triangle"  of  terms  in  the  multidimensional 
space  was  constrained  in  this  way  so  that  problems  would  be  neither  too  easy  nor 
too  difficult:  Very  small  perimeters  (as  would  be  obtained  for  TIGER,  LION, 
LEOPARD)  led  to  probloas  that  were  exceedingly  easy,  whereas  very  large  perimeters 
(as  would  be  obtained  for  GORILLA,  SQUIRREL,  CAMEL)  led  to  problems  that  were 
exceedingly  difficult.  The  permissible  range  for  acceptable  triples  was  rather 
small,  and  forced  modification  of  the  constraints  used  in  selecting  answer  options 
so  that  a  sufficient  number  of  acceptable  items  could  be  produced.  The  new  con¬ 
straints  were  that  (a)  one  answer  option  be  within  .4  scaled  units  of  distance 
from  the  ideal  point;  (b)  a  second  answer  option  be  between  .4  and  .8  scaled  units 
from  the  ideal  point;  (c)  a  third  answer  option  be  between  .8  and  1.2  scaled  units 
from  the  ideal  point;  and  (d)  a  fourth  answer  option  be  at  greater  than  1.2  scaled 
units  from  the  ideal  point;  answer  options  were  not  allo%red  to  overlap  in  content 
with  stem  terms.  Two  hundred  eighty-two  classification  problems  satisfied  all 
of  the  above  constraints.  These  were  sampled  from  randomly  without  replacement 
to  produce  30  classification  problems  for  the  experiment. 

A  standardized  test  of  general  intelligence.  Forms  A  and  B  of  the  Culture 
Pair  Test  of  g.  Level  3  (Cattell  8  Cattell,  196^,  was  also  administered  to  all 
subjects.  The  test  contained  four  types  of  inductive-reasoning  problems— figural 
series  completions,  figural  classifications,  figural  matrix  problems,  and  figural 
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topological  reasoning  problens. 

Procedure 

Subjects  were  tested  in  groups  of  fron  one  to  nine  oeabers.  After  signing 

consent  forms,  subjects  read  instructions  silently  for  the  three  tasks  combined 

while  the  experimenter  read  them  aloud.  Instructions  made  clear  the  natures  of 

the  three  different  tasks,  and  no  subject  expressed  any  questions  about  how  each 

of  the  three  tasks  operated,  or  about  how  they  differed  from  one  another.  Subjects 

then  solved  the  90  test  problems,  which  were  presented  in  paper>and-pencil  format. 

The  subjects'  task  was  to  rank.order  the  answer  options  from  best  to  worst. 

Subjects  were  allotred  as  much  time  as  they  needed  to  finish;  this  time  period 

never  exceeded  l*s  hours.  Subjects  who  finished  before  others  in  their  group  were 

given  an  irrelevant  filler  task.  When  all  subjects  had  completed  the  test  items, 

they  received  the  standardized  intelligence  test.  After  the  test  %fas  completed  (in 

roughly  4S  minutes),  subjects  were  debriefed  and  compensated  for  their  participation. 

« 

Design 

The  main  dependent  variable  was  proportion  of  subjects  choosing  each  possible 
response  as  first,  second,  third,  and  fourth  best.  The  independent  variable  used 
to  predict  these  proportions  was  distance  of  each  option  from  the  ideal  point. 

One  parameter,  a,  was  estimated  for  the  predicted  negative  exponential  function. 
Problems  were  blocked  into  sets  of  30  analogies,  30  series  completions,  and  30 
classifications,  presented  in  counterbalanced  order  across  subjects  such  that 
five  subjects  received  each  of  the  six  possible  orders.  Items  within  a  block 
were  presented  in  a  different  random  order  to  each  subject,  and  answer  options 
within  each  item  were  also  presented  in  a  different  random  order  to  each  sub¬ 
ject.  The  standardized  intelligence  test  was  scored  for  number  of  items  com¬ 
pleted  correctly. 
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Basic  Pats  Sets 

The  basic  data  sets  for  the  present  experiment,  as  well  as  for  Experiment 
1  of  Rumelhart  and  Abrahamson  (1973),  are  shown  in  Table  1.  This  table  shows 


Insert  Table  1  about  here 

the  proportions  of  subjects  ranking  each  answer  option  as  first,  second,  third, 
or  fourth  best,  as  a  function  of  that  option's  distance  from  the  ideal  point. 

First,  it  is  worth  noting  that  the  pattern  of  response  choices  in  the  16 
cells  for  the  present  analogy  data  closely  replicate  those  in  the  16  cells  for 
the  Rumelhart-Abraharason  analogy  data,  r  ■  .99-*-,  RMSD  (root-oean-square  deviation) 

■  .02.  Second,  the  patterns  of  response  choices  across  the  three  tasks  in  the 
present  experiment  are  highly  similar:  For  analogies  and  series  completions, 
r  ■  .99,  RMSD  ■  .03;  for  analogies  and  classifications,  r  *  .97,  RMSD.«  .05;  for 
series  completions  and  classifications,  r  «  .98,  RMSD  «  .04.  These  high  levels 
of  similarity  in  response  choices  are  consistent  with  the  notion  that  a  single 
model  of  response  choice  is  used  in  all  three  tasks.  Further  analysis  is  needed, 
however,  to  test  our  proposal  for  what  this  model  is. 

Tests  of  Model  of  Response  Choice 

The  value  of  a  was  estimated  as  2.52  for  the  analogies,  2.56  for  the  series 
completions,  and  2.93  for  the  classifications.  Although  these  values  differ  sig¬ 
nificantly  from  each  other,  P^(2,48)  ■  3.73,  2.  *  *05,  they  are  certainly  in  the 
same  ballpark,  and  the  most  extreme  value  corresponds  roughly  to  that  obtained 
by  Rumelhart  and  Abrahamson  for  their  analogies,  2.91.  The  somewhat  discrepant 
value,  that  for  classifications,  was  obtained  in  the  task  for  which  slightly  dif¬ 
ferent  constraints  were  set  on  the  distances  of  answer  options  from  the  ideal 
point,  which,  conceivably,  might  have  been  partly  responsible  for  the  discrepancy. . 
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Ve  believe  that  the  three  values  are  close  enough  to  suggest  that  the  decision 
rules  used  for  rank-ordering  options  in  each  of  the  three  tasks  are  extreoely 
siuilar,  if  not  identical. 

The  fits  of  the  exponential  model  to  the  three  data  sets  of  the  present 
experiment  plus  that  of  Rumelhart  and  Abrahamson  (1973,  Experiment  1)  are  shown 
in  Figure  2,  which  compares  predicted  response  choices  to  observed  response 
choices.  For  analogies,  r  ■  .97,  RMSO  ■  .05;  for  series  completions,  r  •  .98, 

Insert  Figure  2  about  here 

RNSD  •  ,04;  for  classifications,  r  •  .99,  RMSD  ■  .03.  Although  the  residual 
variance  was  small  in  each  case,  at  least  part  of  it  was  highly  systematic. 
Residuals  were  correlated  across  task:  The  product-moment  correlations  were  .83 
between  predicted  minus  observed  values  for  analogies  and  series  completions, 

,80  between  residuals  for  analogies  and  classifications,  and  .95  between  residuals 
for  series  completions  and  classifications.  A  visual  inspection  of  the  residuals 
revealed  to  us  at  least  some  of  the  systematic  trends.  Prediction  of  first-choice 
data  tended  to  be  best,  as  expected,  since  o  was  estimated  on  the  basis  of  the 
first-choice  data.  Also,  the  proportion  of  subjects  predicted  to 

choose  the  best  option  as  second  best  was  overestimated  in  all  three  tasks,  while 
the  proportion  of  subjects  predicted  to  choose  the  best  option  as  third  or  fourth 
best  was  underestimated  in  each  case.  Responses  to  the  best  option  were -thus 
■ore  spread  out  than  was  predicted  by  the  model,  perhaps  because  individual  dif¬ 
ferences  in  perceptions  of  distance  increase  as  distance  increases. 

Individual  Differences 

Analyses  of  individual  differences  were  disappointing:  Values  of  a  were 
net  significantly  correlated  with  each  other  across  tasks,  nor  were  they  signifi¬ 
cantly  correlated  with  scores  on  the  Cattell  Culture  Pair  Test  of  £.  Several 
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Other  indices  of  overall  performance  on  the  three  kinds  of  inductive  reasoning 
tasks  were  also  computed,  but  these  did  not  correlate  with  each  other  or  with 
the  ability  test.  The  low  correlations  presumably  reflect  the  low  reliability 
of  the  inductive-reasoning  task  scores  for  individual  subjects,  which  for  pro¬ 
portions  of  items  answered  correctly  were  .24  for.  analogies,  .59  for  series 
completions,  and  .30  for  classifications. 

Discussion 

The  results  of  this  experiment  suggest  that  one  communal ity  in  performance 
across  analogies,  series  completions,  and  classifications  is  in  the  model  of 
response  choice  subjects  use  in  rank-ordering  the  goodness  of  alternative  answer 
options.  The  same  model  seemed  to  be  used  in  each  of  these  three  tasks,  and 
even  the  value  of  the  exponential  response-choice  parameter  seemed  to  be  about 
the  same  in  each  experiment,  and  in  close  agreement  with  that  obtained  by 
Rumelhart  and  Abrahamson  (1973)  in  their  study  of  response  choice  in  analogical 
reasoning.  Although  the  proposed  model  of  response  choice  provided  a  good  fit 
to  the  response-choice  data,  the  residual  variance  was  largely  systematic,  sug¬ 
gesting  that  the  proposed  model  did  not  capture  all  systematic  features  of  the 
subjects*  decision  rule.  The  model  also,  of  course,  does  not  explain  how  subjects 
got  to  the  point  where  they  could  rank-order  the  answer  options.  The  information¬ 
processing  model  described  below  seeks  to  provide  such  an  explanation. 

EXPERIMENT  2 

Our  proposed  model  of  real-time  information  processing  in  inductive  reason¬ 
ing  of  the  sort  required  by  analogies,  series  completions,  and  classifications. 

Is  an  extension  of  the  Sternberg  (1977a,  1977b)  model  of  information  processing 
in  reasoning  by  analogy.  In  this  model,  reasoning  is  viewed  as  involving  (a) 
selection  and  execution  of  a  set  of  components  for  solving  reasoning  problems, 

(b)  selection  and  execution  of  a  strategy  for  combining  these  components,  (c) 
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selection  and  utilization  of  an  internal  representation  for  infomation  upon  which 
the  conponents  and  strategy  act,  (d)  selection  and  aaintenance  of  a  speed-accuracy 
tradeoff  whereby  components  are  executed  at  a  rate  that  produces  an  acceptable 
level  of  accuracy  in  performance,  and  (e)  monitoring  of  one's  decisions  and  solu¬ 
tion  processes  to  assure  that  information  processing  is  leading  toward  an  accep¬ 
table  solution  to  the  problem  at  hand. 

Response  time  in  reasoning  is  hypothesized  to  equal  the  sum  of  the  amounts 
of  time  spent  on  the  various  information-processing  components  used  in  problem 
solution.  Hence,  a  simple  linear  model  predicts  response  time  to  be  the  sum 
across  the  different  components  of  the  number  of  times  each  component  operation 
is  performed  (as  an  independent  variable)  multiplied  by  the  duration  of  that  com¬ 
ponent  operation  (as  an  estimated  parameter).  Proportion  of  response  errors  is 
hypothesized  to  equal  the  (appropriately  scaled)  sum  of  the  difficulties  encoun¬ 
tered  in  executing  each  component  operation.  A  simple  linear  model  predicts 
proportion  of  errors  to  be  the  sum  across  the  different  component  operations  of  the 
number  of  times  each  component  operation  is  performed  (as  an  independent  variable) 
multiplied  by  the  difficulty  of  that  component  operation  (as  an  estimated  parameter). 
This  additive  combination  rule  is  based  upon  the  assumption  that  each  subject  has 
a  limit  on  processing  capacity  (or  space;  see  Osherson,  1974).  Each  execution  of 
an  operation  uses  up  capacity.  Until  the  limit  is  exceeded,  performance  is  flaw¬ 
less  except  for  constant  sources  of  error  (such  as  motor  confusion,  carelessness, 
momentary  distractions,  etc.).  Once  the  limit  is  exceeded,  however,  performance 
is  at  a  chance  level  (Sternberg,  1977a). 

Consider  as  an  example  the  analogy.  TIGER  :  CHIMPANZEE  ;;  iOLF  :  (1.  CAMEL, 

2.  MONKEY).  According  to  the  theory,  a  subject  encodes  each  term 

of  the  analogy,  retrieving  from  semantic  memory  and  placing  in  working  memory 
the  locations  in  semantic  space  of  the  terms  of  the  problem;  next,  the  subject 
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infers  the  relation  between  TIGER  and  CHIMPANZEE,  recognizing  the  vector  distance 
between  these  first  two  terms  of  the  analogy;  then,  the  subject  maps  the  higher- 
order  relation  between  the  first  and  second  halves  of  the  analogy,  here  recog¬ 
nizing  the  vector  distance  from  the  term  heading  the  first  half  (TIGER)  to  the 
term  heading  the  second  half  (WOLF);  next,  the  subject  applies  the  relation  in¬ 
ferred  between  the  first  two  terms  from  the  third  analogy  term,  here,  WOLF,  to 
form  an  ideal  point  representing  the  ideal  solution  to  the  analogy;  then,  the 
subject  compares  answer  options,  seeking  the  ideal  solution  from  among  the  answers 
presented;^  if  none  of  the  answer  options  corresponds  to  the  ideal  point,  the  subject 
must  justify  one  of  the  answer  options  as  preferable  to  the  other(s),  in  that  it 
is  closest  to  the  ideal  point  (MONKEY  is  closer  than  CAMEL);  finally,  the  subject 
responds  with  the  chosen  answer,  MONKEY. 

How  does  the  information-processing  model  described  above  interface  with  the 
model  of  response-choice  described  earlier?  Essentially,  the  exponential  response- 
choice  parameter  of  the  response-choice  model  quantifies  the  decision  rule  used 
during  justification  of  one  response  as  superior  to  the  others:  It  represents  an 
end-product  of  the  series  of  reasoning  components.  In  a  rank-ordering  task,  the  sub¬ 
ject  applies  justification  repeatedly,  successively  assigning  rank  i  to  the  altema. 
tive  that  is  ^th  closest  to  the  ideal  point.  Errors  within  and  between  subjects  in 
the  calculation  of  distances  between  the  ideal  point  and  the  various  answer  options, 
as  well  as  differences  in  placements  of  points  in  the  mammal-name  space,  lead  to 
intra-  and  inter-individual  differences  in  assignments  of  ranks  in  accordance 
with  the  exponential  function. 

The  same  basic  model  can  be  extended  to  series  completion  problems.  Consider, 
for  example,  the  series  completion,  SQUIRREL  :  CHIPMUNK  :  (i,  RACCOON,  2.  HORSE). 

The  subject  must  encode  each  term  of  the  series  completion.  Next,  he  or  she  infers 
the  relation  of  succession  between  SQUIRREL  AND  CHIPMUNK.  Mapping  is  not 
necessary  in  this  and  other  series  problems,  because  there  is  no  distinction 
between  domnin  and  ranTe:  All  terms  of  the  nroSlem  derive  from  x  single,  homo- 
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(eneous  domain:  Geometrically,  there  is  no  realignment  of  vectors  from  one  area  of 
the  space  (A:^)  to  another  (£:!)•  ‘Hie  subject  must,  however,  apply  the  relation 
inferred  between  SQUIRREL  and  CHIPMUNK  from  CHIPMUNK  to  an  ideal  point.  Next,  the 
subject  compares  the  answer  options,  seeking  the  one  corresponding  to  the  ideal 
point.  If  neither  option  (or  in  the  case  of  more  than  two  options,  none  of  the 
options)  corresponds  to  the  ideal  point,  the  subject  justifies  one  option  as  closer 
or  closest  to  the  ideal  point.  In  the  present  example,  RACCOON  is  closer  to  the 
ideal  point  than  is  HORSE.  Finally,  the  subject  responds  with  the  chosen  answer. 

As  in  the  case  of  analogies,  the  rank-ordering  task  would  require  multiple  justifica¬ 
tions  to  determine  which  option  is  closest  to  the  ideal  point,  of  those  options 
not  yet  ranked. 

The  model  can  also  be  extended  to  classification  problems.  Consider,  for 
example,  the  problem,  ZEBRA,  GIRAFFE,  GOAT,  (1.  COW,  2.  DOG).  The  subject 
must  encode  the  terms  of  the  problem.  Next,  the  subject  must  infer  what  is 
common  to  ZEBRA,  GIRAFFE,  and  GOAT,  in  essence  seeking  a  prototype  or  centroid 
that  abstracts  what  is  common  to  the  three  terms;  as  was  the  case  in  the  series- 
conqpletion  problems,  the  subject  need  not  map  any  higher-order  relation,  since  all 
of  the  terms  of  the  problem  are  from  a  single,  homogeneous  domain.  In  clas¬ 
sification  problems,  application  is  also  unnecessary,  because  the  inferred  centroid 
is  the  ideal  point:  The  subject  need  not  extrapolate  in  any  way  to  seek  some 
further  point  in  the  multidimensional  semantic  space.  Next,  the  subject  compares 
the  answer  options,  seeking  the  ideal  solution.  If  none  is  present,  the  subject 
justifies  one  option  as  closer  to  the  ideal  point  than  the  other(s).  Finally, 
the  subject  responds.  As  in  the  case  of  analogies  and  series  completions,  rank¬ 
ordering  the  options  requires  multiple  executions  of  the  justification  component. 


Ranking  in  these  problems  and  in  the  series  completions  proceeds  according  to  the 
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decision  rule  described  in  Experinent  1. 

Nhereas  the  same  single  parameter  of  response  choice  applies  in  all  three 
inductive  reasoning  tasks,  the  parameters  of  information  processing  in  the  three 
tasks  are  slightly  different:  The  analogies  task  requires  the  full  set  of  seven 
information-processing  parameters;  the  series  completion  task  requires  a  subset 
of  six  of  the  seven  parameters  in  the  analogies  task;  the  classification  task 
requires  a  subset  of  five  of  the  six  parameters  in  the  series  completion  task. 

Thus,  one  would  expect  that  for  problems  with  terms  of  equal  difficulty,  analogies 
would  be  slightly  more  difficult  than  series  completion  problems,  and  series 
completion  problems  would  be  slightly  more  difficult  than  classification  problems. 

In  Experiment  2,  subjects  were  presented  with  30  analogies,  30  series  comple¬ 
tions,  and  30  classifications  (in  an  order  counterbalanced  across  subjects).  The 
subjects'  task  was  to  select  the  better  of  two  alternative  answer  options  in  terms 
of  its  appropriateness  as  a  completion  to  the  problem  stem.  The  subjects  were  timed 
as  they  solved  each  item. 

Method 

Subj ects 

Thirty-six  college-age  adults  from  the  New  Haven  area — 17  women  and  19  men— 
participated  in  the  experiment.  Subjects  received  pay  at  the  rate  of  $2.50  for 
their  participation  in  the  experiment. 

Materials 

The  30  analogies,  30  series  completions,  and  30  classifications  had  the  same 
stems  as  the  items  in  Experiment  1.  They  differed  from  the  items  in  Experiment  1, 
however,  in  having  two  rather  than  four  answer  options.  Hie  two  options  in  each 
problem  were  randomly  chosen  with  the  constraint  that  each  possible  pairing  of 
options  0>est  with  second  best,  best  with  third  best,  best  with  worsts  second  best 
with  third  best,  second  best  with  worst,  third  best  with  worst) 
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be  equally  represented.  Since  there  were  six  possible 
kinds  of  pairings,  five  items  of  each  of  the  three  problem  types  contained  one 
of  the  kinds  of  pairings. 

Three  standardized  ability  tests  were  used  in  this  experiment.  Like  the 
tost  in  the  first  experiment,  the  items  required  inductive  reasoning  of  the  kind 
required  for  solution  of  the  items  in  the  main  part  of  the  experiment.  The 
tests  were  figural  classifications  and  figural  analogies  from  Form  1  of  the 
Cognitive  Abilities  Test,  Level  H  (Thorndike  §  Hagen,  1971), 
and  figural  analogies  from  Form  T  of  the  Differential  Aptitude  Test  (Bennett, 
Seashore,  §  Wesman,  1972). 

Procedure 

Subjects  were  tested  individually.  Stimulus  items  were  presented  tachisto- 
scopically,  and  response  latencies  were  timed  via  an  attached  millisecond  clock. 
The  stimuli  were  presented  via  the  method  of  precueing  (Sternberg,  1977b,  1973), 
whereby  each  stimulus  trial  is  divided  into  two  parts.  In  the  first  part  of  the 
trial,  the  subject  received  some  amount  of  precueing;  the  subject  was  told  to 
take  as  long  as  he  or  she  needed  to  process  the  advance  information  fully,  but 
no  longer.  In  the  second  part  of  the  trial,  the  subject  received  the  full  stimu¬ 
lus  item;  the  subject  was  told  to  solve  the  item  as  quickly  as  possible,  using 
whatever  information  may  have  been  gleaned  from  the  first  part  of  the  trial, 
without  making  an  error.  There  were  two  conditions  of  precueing:  In  an  uncued 
condition,  the  first  part  of  the  trial  consisted  merely  of  a  lighted,  blank 
field;  in  a  cued  condition,  the  first  part  of  the  trial  consisted  of  either  the 

first  two  terms  of  the  item  (analogies  and  series  completions)  or  the  first  three 

terms  of  the  item  (classifications).  The  second  part  of  the  trial  was  always 
presented  one  second  after  the  subject  indicated  by  pressing  a  button  that  he 

or  she  had  completed  processing  of  the  first  part  of  the  trial.  The  purpose 
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of  the  precueing  was  to  facilitate  separation  of  paraneters  that  would  other¬ 
wise  have  been  confounded:  The  data  of  pr inary  interest  were  those  from  the  second 
part  of  the  trial,  in  which  the  full  item  was  presented. 

Each  item  was  presented  twice,  once  in  the  uncued  condition  and  once  in  the 
cued  condition.  Items  were  presented  in  12  blocks  of  IS  items  each.  Each  block 
contained  a  single  type  of  item  (analogies,  series  completions,  or  classifications) 
in  a  single  condition  of  precueing  (uncued  or  cued) .  Item  types  alternated  across 
Successive  blocks  such  that  subjects  always  received  one  of  the  six  possible  permu¬ 
tations  of  analogies,  series  completions,  and  classifications  in  three  adjacent 
blocks.  The  same  permutation  was  used  repeatedly  (four  times)  for  a  given  subject, 
but  permutations  were  varied  across  subjects.  Precueing  conditions  alternated 
across  successive  blocks  such  that  ff  cued  block  always  followed  an  uncued  block 
(or  vice  versa)  until  the  full  set  of  items  had  been  exhausted  after  six  blocks. 

At  this  point,  each  item  had  been  presented  in  one  or  the  other  condition  of 
precueing.  Then  the  items  were  re-presented  according  to  the  same  scheme,  ex¬ 
cept  that  each  item  was  presented  in  the  precueing  condition  in  which  it  had  not 
yet  appeared.  Testing  on  the  stimulus  items  consumed  roughly  24  hours. 

The  ability  tests  were  administered  in  pencil-and-paper  format  in  fixed 
order  (figural  classifications,  then  figural  analogies,  then  figural  series  com¬ 
pletions)  upon  completion  of  the  tachistoscopic  testing.  Ability  testing  took 
about  4  hour,  and  was  conducted  in  a  separate  session. 

Design 

The  main  dependent  variable  was  response  latency  to  solution  in  the  second 
part  of  the  trial.  Error  rate  served  as  a  subsidiary  dependent  variable.  It 
was  assumed  that  subjects  used  prior  information  presented  in  the  cued  condition 
to  reduce  as  much  as  possible  the  information  processing  required  in  the  second 
part  of  the  trial.  For  example,  when  presented  with  the  first  two  terms  of  an 
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amtlogy  in  the  first  part  of  the  trial,  subjects  were  assumed  to  encode  these 
terns  and  to  infer  the  relation  between  them  so  that  they  would  not  have  to 
perform  these  operations  in  the  second  part  of  the  trial.  The  independent 
variables  used  to  predict  response  latencies  and  error  rates  in  the  second 
part  of  the  trial  for  cued  items  thus  took  into  account  information  processing 
In  the  first  part  of  the  trial.  The  independent  variables  (for  both  cued 
and  uncued  items)  were  (a)  the  number  of  terms  to  be  encoded;  (b)  spatial  dis> 
tance  between  A  and  ^  (for  analogies  and  series  completions)  or  the  maximum  of 
the  three  distances  between  A  and  B,  A  and  C,  and  B  and  C  (for  classifications), 
used  to  estimate  inference  time  and  difficulty;  (c)  spatial  distance  between 
A  and  £  (for  analogies),  used  to  estimate  mapping  time  and  difficulty;  (d)  spa¬ 
tial  distance  between  £  and  £  (for  analogies)  or  between  B  and  I  (for  series 
completions),  used  to  estimate  application  time  and  difficulty;  (e)  spatial 


distance  between  and  (for  analogies  and  classifications)  or  between  £j 


and  £2  (for  series  completions),  used  to  estimate  comparison  time  and  difficulty; 

(f)  spatial  distance  between  £  and  (for  analogies  and  classifications) 

or  between  £  and  C^^yg^Cfor  series  completions) ,  used  to  estimate  justification  time 
and  difficulty.  Motor  response  time  and  difficulty  were  estimated  as  regression  constan' 
Subjects  were  crossed  with  precueing  conditions  and  with  items  such  that 
each  Subject  received  each  item  in  each  condition  of  precueing.  Items  within 
a  block  were  presented  in  a  different  random  order  to  each  subject.  Ability 
tests  were  scored  for  number  of  items  crapleted  correctly. 

Results 


Basic  Statistics 

Table  2  presents  mean  response  latencies  for  all  items  (correctly  answered 
and  incorrectly  answered  combined)  and  for  correctly  answered  items  only. 


Insert  Table  2  about  here 
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Recall  that  according  to  the  proposed  information-processing  model,  errors  can 
result  when  an  overflow  occurs  in  the  processing  capacity  or  space  allocated 
to  a  given  item.  When  an  overflow  occurs,  some  items  are  answered  correctly  by 
chance;  others  are  answered  incorrectly.  An  incorrect  answer  guarantees  that 
an  overflow  has  occurred,  although  a  correct  answer  does  not  guarantee  that  one 
has  not  occurred,  since  the  answer  may  have  been  correct  by  chance.  But  the  sane 
information-processing  model  applies  in  any  of  these  events.  Hence,  modeling  was 
performed  upon  all  data  points.  In  fact,  modeling  correct  latencies  only  would 
have  had  little  differential  effect,  since,  as  can  be  seen  in  the  table,  the  mean 
values  for  the  two  data  sets  were  very  close  to  each  other,  and  since  the  correla- 
tionjacross  item  types  between  the  two  data  sets  were  very  high  (.95  for  analogies, 
,93  for  series  completions,  and  .97  for  classifications) 

A  two-way  analysis  of  variance  on  all  solution  latencies  revealed  a  signifi¬ 
cant  effect  of  task,  F(2,70)  *  30.12,  £  <  .01,  and  of  precueing,  F^(l,35)  •  145.51 
£  <  ,01,  The  interaction  was  not  significant,  £(2,70)  ■  .74  ,  £  >  .10.  A  two- 
way  analysis  of  variance  on  error  rates  also  revealed  a  significant  effect  of  task, 
£(2,70)  ■  6.64,  £  <  .01,  but  a  nonsignificant  effect  of  precueing  condition,  £(1,35) 

■  1.52,  £>  .10,  The  interaction  was  nonsignificant,  £(2,70)  ■  .29,  £>  .10. 

It  is  of  interest  to  note  that  analogies  were  solved  most  slowly,  series 
completions  next  most  slowly,  and  classifications  most  rapidly.  This  is  the  rank 
order  of  processing  time  predicted  by  the  model,  according  to  which  analogies  re¬ 
quire  one  more  component  than  do  series  completions,  which  in  turn  require  one 
■ore  component  than  do  classifications.  The  error  rates  did  not  show  this  pattern: 
Although  classifications  had  a  lower  mean  error  rate  than  did  analogies,  series 
completions  had  the  highest  error  rate.  We  are  uncertain  as  to  how  to  account 
for  this  finding. 
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Task  Intercorrelations  and  Factor  Structure 

Intercorrelations  across  subjects  were  computed  between  mean  response  la- 
tencies  for  each  pair  of  data  sets:  The  correlations  were  .8S  between  analogies 
and  series  completions,  .86  between  analogies  and  classifications,  and  .88  be¬ 
tween  series  completions  and  classifications.  A  principal -components  factor 
analysis  of  the  three  sets  of  latencies  revealed  a  strong  general  factor  in 
the  first,  unrotated  principal  component,  accounting  for  91%  of  the  variance  in 
the  individual-differences  data.  Had  the  tests  shown  no  overlap  in  individual 
differences  variation  (zero  intercorrelations),  this  factor  would  have  accounted 
for  only  33%  of  the  individual-differences  variation.  The  data  are  thus  consis¬ 
tent  with  the  notion  that  a  single  real-time  information-processing  model  might 
apply  across  tasks. 

A  comparable  set  of  analyses  was  performed  on  the  ability- test  scores: 

Here,  the  correlations  were  .72  between  analogies  and  series  completions,  .45 
between  analogies  and  classifications,  and  .65  between  series  completions  and 
classifications.  A  principal-components  factor  analysis  of  the  three  sets  of 
test  scores  (numbers  correct)  revealed  an  unrotated,  general  first  factor  ac¬ 
counting  for  74%  of  the  variance  in  the  individual-differences  data.  Again, 
such  a  factor  would  have  accounted  for  only  33%  of  the  individual-differences  variation 
if  the  intertask  correlation  had  been  0.  These  results,  too,  are  con¬ 

sistent  with  the  notion  of  common  processes  across  tasks.  Indeed,  high  correla¬ 
tions  and  the  resulting  strong  general  factor  resulting  from  sets  of  ability 
tests  like  these  were  the  first  psychometric  clue  we  had,  historically,  that 
common  processes  were  involved  across  inductive  reasoning  tasks  found  on  intel¬ 
ligence  tests. 

Finally,  intercorrelations  were  computed  between  task  scores  across  the  two 
forms  of  task  presentation  (tachistoscopic,  leading  to  response  latencies,  and 
pencil-and-paper,  leading  to  numbers  correct).  Correlations  across  task  format 
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were  lower  than  those  within  fonaat,  as  would  be  expected  if  there  were  at  least 
some  aedlun-specific  variance  that  were  not  shared  across  task  formats.  Such 
■ediuB«specific  variance  might  result  from  differences  across  task  formats  in 
speed-accuracy  tradeoffs,  in  attentional  allocations  for  items  presented  singly 
Cas  in  a  tachistoscopic  task)  and  for  items  presented  as  a  group  (as  in  a  pencil- 
and-paper  task),  in  kinds  of  strategy  or  other  planning  required,  or  in  what  is 
measured  by  latency  and  accuracy  scores.  Most  probably,  some  combination  of 
these  and  other  factors  was  involved.  The  correlations  ranged  from  -.21  to  -.41, 
with  a  median  for  the  nine  intertask  correlations  of  -.35  (£  <  .05).  Correla¬ 
tions  of  tasks  with  their  analogues  across  formats  (e.g.,  tachistoscopic  analo¬ 
gies  with  pencil -and-paper  analogies)  were  only  trivially  higher  than  correlations 
of  nonanalogous  tasks  across  formats  (e.g.,  tachistoscopic  analogies  with  pencil- 
and-paper  series  completions):  The  median  correlation  for  analogous  tasks  was 
-.35  (£  <  .05),  whereas  the  median  correlation  for  nonanalogous  tasks  was  -.30 
(£  <  .05).  A  factor  analysis  of  the  six  tasks  (three  tachistoscopic  and  three 
pencil-and-paper)  yielded  a  first,  unrotated  principal  component  accounting  for 
57%  of  the  variance  in  the  data.  If  tests  were  uncorrelated,  a  value  of  17%  would 
have  been  obtained.  The  response  latencies  all  loaded  in  the  .80s  on  this  factor, 
whereas  the  number-correct  measures  all  loaded  in  the  .60s  on  the  factor.  The 
higher  loadings  of  the  response-latencies  would  be  expected  on  the  basis  of  their 
higher  intercorrelations  with  each  other.  As  expected,  the  second  unrotated  prin¬ 
cipal  component,  accou^ing  for  26%  of  the  variance  in  the  data,  was  a  bipolar 
factor  distinguishing  ^ncil -and -paper  tasks  from  response-latency  ones.  The 
general  factor  unifying  the  various  kinds  of  tasks  was  thus  about  twice  as  strong 
as  the  medium-specific  factor  differentiating  the  two  task  formats.  Subsequent 
factors  were  of  little  interest. 
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Tests  of  Model  of  Information  Processing 

Response  latencies.  The  proposed  model  of  information  processing  was  fit 
to  the  response  latencies  for  xincued  and  cued  conditions  combined  (60  data  points) 
in  each  of  the  three  tasks.  Four  parameters — encoding,  comparison,  justification, 
and  response — could  be  estimated  reliably  in  each  of  the  three  tasks,  and  hence 
final  models  were  based  only  upon  these  four  parameters.  Other  parameters  could 
be  estimated  reliably  in  some  tasks  but  not  others,  but  since  our  interest  was 
in  unities  in  information  processing,  these  parameters  were  deleted  from  the  final 
common  model.  It  is  impossible  to  say  whether  the  failure  to  estimate  these 
other  parameters  reliably  was  due  to  insufficient  stability  of  the  data  or  to 
failure  of  the  full  model  to  account  for  information  processing  in  one  or  more 
tasks.  Further  analyses  will  be  based  only  upon  the  common  parameters. 

Table  3  shows  parameter  estimates  for  each  parameter  in  each  task.  If  the 

Insert  Table  3  about  here  ' 

tasks  truly  involve  the  same  components,  then  the  parameter  estimates  should  be 
equal  within  a  margin  of  error  of  estimation  across  tasks. ^  A  one-way  analysis 
of  variance  was  conducted  across  tasks  upon  each  of  the  four  parameter  estimates 
of  interest.  For  encoding,  £(2,70)  -  2.81,  .05  <  £  <  .10;  for  comparison,  £(2,70) 

■  '.46,  £»  .10;  for  justification,  F(2,70)  ■  9.88,  £<  .001;  for  response,  £(2,70) 

■  2*48,  .05  <  £  <  .10.  Only  one  of  the  parameters— justification— showed  a  clearly 
significant  difference  in  value  across  the  three  tasks;  two  others  showed  marginally 
significant  differences,  and  one  showed  no  difference  at  all.  These  results  are 
interpreted  as  at  least  modestly  supportive  of  process  equivalence  or  near-equivalence 
across  tasks,  with  the  exception  of  the  result  for  justification. 

The  fits  of  the  model  to  the  three  sets  of  data  were  assessed  by  correlating 
predicted  with  observed  values  and  by  calculating  the  root -mean-square  deviation 
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(RMSD)  of  observed  from  predicted  values.  For  analogies,  r  ■  .88,  RMSD  ■  1.10 
seconds;  for  series  completions,  r  ■  .82,  RMSO  ■  .92  seconds;  for  classifications, 

T  ■  .78,  RMSO  ■  1.09  seconds.  The  maximum  possible  values  of  the  correlations 
according  to  classical  test  theory  are  the  square  roots  of  the  reliabilities  of 
the  data  sets,  which  were  .96  for  analogies,  .92  for  series  completions,  and 
.93  for  classifications.  Thus,  most  but  not  all  of  the  systematic  variance  in  the 
data  was  accounted  for  by  the  model.  Residuals  of  observed  from  predicted  values 
were  correlated  for  random  halves  of  the  subjects,  and  corrected  by  the  Spearman- 
Brown  formula.  All  correlations  were  statistically  significant  (.61  for  analogies, 

.64  for  series  completions,  .75  for  classifications),  indicating  that  the  residual 
variance  was  indeed  quite  reliable.  At  least  some  of  this  unaccounted  for  variance 
was  probably  attributable  to  parameters  that  were  not  statistically  reliable  for  all 
three  tasks,  and  hence  were  not  included  in  the  final  model  fitting  for  any  of 
the  tasks.  Further  unexplained  variance  probably  resulted  from  attributes  of  mammals  { 

i 

that  are  not  captured  by  the  three-dimensional  spatial  representation  into  which 
the  maiBoals  were  placed. 

Error  rates.  Similar  modeling  was  done  for  error  rates,  although  parameter 
estimates  for  individuals  were  extremely  unstable,  and  could  not  be  compared 
across  tasks.  Pits  were  assessed  by  the  correlation  between  predicted  and  observed 

I 

1 

values  and  by  root -mean-square  deviation.  For  analogies,  r  ■  .43,  RMSD  •  ,16; 
for  series  completions,  r  ■  .61,  RMSD  ■  .IS;  for  classifications,  r  ■  .39,  RMSD  -  .16.  | 
The  respective  square  roots  of  the  reliability  coefficients  were  .92,  .92,  and  .93. 
Correlations  of  Latency  Parameters  across  Tasks  i 

Correlations  were  computed  across  pairs  of  latency  parameters  for  individual 
tasks.  These  correlations  were  generally  positive  but  statistically  nonsignificant, 
perhaps  in  part  because  each  individual  parameter  estimate  was  computed  on  the  basis 
of  only  a  single  observation  for  each  of  60  data  points  (30  uncued  and  30  precued). 
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Discussion 

The  results  of  this  experiment  suggest  that  one  communality  in  performance 
across  analogies,  series  completions,  and  classifications  is  in  the  model  of 
information  processing  subjects  use  in  solving  the  induction  problems.  The 
same  model  seemed  to  be  used  in  each  of  the  three  tasks,  and  the  values  of  the 
real-time  information  processing  parameters  were  generally  comparable  across 
tasks,  with  the  notable  exception  of  justification.  Because  previous  tests  of 
the  proposed  model  on  analogy  problems  were  conducted  upon  problems  with  very 
different  types  of  content,  it  was  not  possible  to  compare  parameter  estimates 
obtained  in  this  experiment  to  those  obtained  in  previous  work  (e.g. ,  Sternberg, 
1977b).  Although  the  proposed  model  of  information  processing  provided  a  good 
fit  to  the  latency  data  and  a  fairly  good  fit  to  the  less  reliable  error  data, 
the  residual  variance  was  systematic  at  least  in  part,  suggesting  that  the 
proposed  model  did  not  capture  all  systematic  features  of  the  subjects'  informa, 
tion  processing.  The  model  does  not,  of  course,  explain  how  subjects  actually 
decide  upon  their  response  choices:  This  function  is  served  by  the  previously 
described  model  of  response  choice,  which  fills  in  the  decisions  that  take  place 
during  execution  of  the  justification  component. 

GENERAL  DISCUSSION 

The  two  experiments  reported  in  this  article,  taken  together,  suggest  that 
the  high  intercorrelations  found  in  the  past  across  subjects'  performance  on  three 
inductive  reasoning  tasks  commonly  found  in  intelligence-testing  batteries  were 
probably  due  at  least  in  part  to  communalities  in  models  of  response  choice  and 
information  processing  used  in  the  three  tasks.  Results  of  the  first  experiment 
indicated  that  the  Rumelhart-Abrahamson  (1973)  model  of  response  choice  in  analogi 
cal  reasoning  could  be  extended  to  series  completions  and  classifications  as  well; 
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results  of  the  second  ezperiaent  indicated  that  the  Sternberg  (1977a,  1977b)  aodel 
of  information  processing  in  analogical  reasoning  could  be  similarly  extended. 

The  unities  identified  in  this  experiment  have  been  demonstrated  only  for 
reasoning  problems  using  a  single  type  of  content-mammal  names.  In  order  to 
build  a  strong  case  for  a  unified  account  of  inductive  reasoning  in  the  three 
tasks  studied  here,  one  would  want  to  demonstrate  communal ities  across  contents 
as  well  as  within  a  single  content.  One  of  us  is  currently  engaged  in  analyzing 
data  from  such  research  (Sternberg,  Note  2),  where  the  three  tasks  considered  in 
this  experiment  are  crossed  with  three  different  types  of  content-schematic- 
picture,  verbal,  and  geometric. 

The  implementations  of  the  models  described  in  this  research  assumed  a 
multidimensional  representation  for  information  in  the  data  base  upon  which  infor¬ 
mation  processing  took  place.  This  assumption  limits  the  content  domains  to  which 

the  theories  as  implemented  here  can  be  expeditiously  applied,  since  only  semantic 

8 

fields  seem  to  yield  clean,  interpretable,  and  replicable  dimensions.  Previous 
research  has  shown  that  theory  testing  can  be  carried  quite  far  through  the  use  of 
sosantic  fields  (e.g..  Rips,  Shoben,  8  Smith,  1973;  Rumelhart  S  Abrahamson,  1973; 
Shepard,  1964;  Shepard,  Kilpatric,  8  Cunningham,  197S;  Smith,  Shoben,  8  Rips,  1974; 
Sternberg,  Tourangeau,  8  Nigro,  1979;  Tourangeau  8  Sternberg,  in  press).  Never¬ 
theless,  the  constraint  of  using  a  semantic  field  must  be  seen  as  limiting  the 
generality  of  the  results.  It  must  be  emphasized  that  this  constraint  is  a  practi¬ 
ce!  one  rather  than  a  theoretical  one,  in  the  sense  that  a  spatial  representation 
might  apply  to  items  not  falling  into  semantic  fields,  but  merely  be  difficult  to 
reproduce  through  the  experimental  and  sealing  techniques  presently  available  to  us 
Ve  agree  with  Hutchinson  and  Lockheed  (1977)  that  a  spatial  representation  provides 
a  rather  general  form  of  representation  for  a  variety  of  purposes,  and  with  Hollan 
(197$)  that  spatial  and  network  models  are  mathematically  interchangeable.  Rips, 
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Smith,  and  Shoben  (1975)  have  noted  that  the  choice  of  representation  serves  a 
largely  heuristic  function,  and  in  the  present  research,  the  spatial  representa¬ 
tion  seeas  to  have  served  this  function  reasonably  well.  Although  we  believe 
that  subjects  use  a  spatial  representation  in  solving  these  problems,  we  also 
believe  that  other  representations  are  available  to  subjects  as  they  solve  these 
(and  other)  problems,  and  that  subjects  make  use  of  these  alternative  represen¬ 
tations  as  needed.  To  Illustrate,  modeling  of  error  rates  in  the  first  experi¬ 
ment  reported  here  (and  in  a  previously  reported  experiment,  Sternberg,  1977b) 
reveals  that  an  overlapping  clustering  model  (Shepard  5  Arable,  1979)  fits  the 
error  data  quite  well  for  analogies  and  classifications.  In  classifying  three 
animals  such  as  a  LION,  TIGER,  and  LEOPARD  as  similar,  for  example,  it  seems 
quite  likely  that  subjects  would  cluster  them  as  "ferocious  jungle  beasts"  as 
well  as  Identifying  them  according  to  their  size,  ferocity,  and  humanness  in 
a  spatial  representation.  The  cluster  representation  does  not  work  well  for 
series  completions,  where^  logically  as  well  as  psychologically,  it  would  seem 
Inappropriate.  As  mentioned  earlier,  some  of  the  systematic  unexplained  variance 
in  the  modeling  of  the  data  in  these  experiments  was  probably  due  to  alternative 
encodings  of  the  mammal  names  that  are  not  captured  in  the  first  three  dimensions 
of  a  spatial  model  of  representation. 

Another  simplification  in  the  present  research  is  the  assumption  that  an 
additive,  serial  model  of  information  processing  describes  the  sequencing  of  infor¬ 
mation  processing  in  the  execution  of  strategy  for  solving  induction  items.  In 
fact,  it  seems  unlikely  that  subjects  process  information  strictly  in  this  manner.  G 
din  (in  press)  has  presented  evidence  suggesting  that  in  analogy  solution,  subjects 
sometimes  infer  the  relation  between  A  and  C  and  map  the  relation  between  A  and  B, 
rather  tnan  the  other  way  around.  Whitely  and  Barnes  (1979)  have  presented  evi- 
dence  suggesting  that  there  are  at  least  some  individual  differences  in  the  order 
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In  which  subjects  process  infomation  in  analogy  solution.  The  work  of  Siaon  and 
Botovsky  (1963)  also  suggests  foms  that  individual  differences  night  take  in 
the  solution  of  series  completions.  The  approxiaation  proposed  in  this  article 
seou  like  a  reasonable  start  toward  understanding  reasoning  in  induction  prob- 
leas,  although  there  is  certainly  a  long  way  to  go  in  this  quest. 

The  present  research  goes  far  enough  to  suggest  that  there  are  important 
coaaunalities  in  the  rules  for  response  choice  and  the  strategies  for  informa* 
tlon  processing  used  in  three  induction  tasks,  but  it  does  not  go  far  enough 
to  suggest  just  what  psychological  aechanisas  underlie  these  communal ities.  Pro¬ 
cesses  such  as  "encoding"  and  "inference"  need  to  be  unpacked  in  order  to  deter¬ 
mine  not  just  what  is  done,  but  how  it  is  done. 

We  have  concentrated  upon  communalities  across  induction  tasks  in  the  per¬ 
formance  component  of  information  processing,  but  we  believe  that  another  major 
source  of  communalities  across  these  and  other  tasks  is  to  be  found  at  the 
"metacomponential"  level  of  information  processing  (Sternberg,  1979,  Note  3), 
where  plans  and  decisions  are  made  regarding  what  performance  components  will  be 
used  in  information  processing.  The  problem  of  isolating  the  metacomponents 
of  information  processing  from  composite  task  performance  is  currently  being 
pursued  by  one  of  us  (R.J.S.)  in  collaboration  with  Bill  Salter. 

One  of  the  most  widely  replicated  findings  in  the  literature  on  human  intelli 
gence  is  that  of  a  general  factor  of  intelligence,  whereby  people  who  tend  to 
perform  well  (or  poorly)  on  one  set  of  tasks  also  tend  to  perform  well  (or  poorly) 
on  other  sets  of  tasks.  Although  the  finding  of  a  general  factor  can  scarcely  be 
disputed  at  this  point  in  time,  the  psychological  explanation  for  this  finding  has 
been  a  source  of  considerable  debate  (Hunt,.  1978;  Spearman,  1927;  Thomson,  1939; 
Thorndike,  Bregman,  Cobb,  8  Woodyard,  1928;  Sternberg,  1979;  Hunt,  Note  4;  Jensen, 
Note  5;  Sternberg,  Note  3).  The  present  article  suggests  some  possible  sources 


Unities  in  Inductive  Reasoning 
32 

of  generality  in  an  inportant  subset  of  intelligent  behavior,  that  of  inducing 
structure. 

In  one  respect,  the  aajor  objective  of  the  present  research  is  consistent 
with  that  of  traditional  factor-analytic  research:  Both  kinds  of  research  seek  to 
understand  sources  of  communal ities  in  performance  on  different  complex  information* 
processing  tasks.  In  another  respect,  however,  the  objective  is  quite  different: 

The  present  research  seeks  these  sources  of  communality  in  dynamic  information¬ 
processing  constructs  rather  than  in  static  factorial  ones.  In  this  respect, 
the  research  is  similar  in  its  major  objective  to  the  research  of  Carroll  (1976), 
Hunt,  Lunneborg,  and  Lewis  (1975),  and  Sternberg  (1977b).  Factors  are  viewed  as 
interpretable  in  information  processing  terms,  and  hence  as  reducible  to  more 
elementary  sources  of  individual  differences.  But  just  as  it  was  necessary  to 
Understand  factors  in  terms  of  the  more  basic  information-processing  components 
that  constitute  them,  so  is  it  now  necessary  to  understand  the  psychological 
mechanisms  that  are  used  to  effectuate  these  performance  components.  Research 
on  metacomponents  may  prove  to  be  a  start  in  this  direction,  although  it  is  too 
early  to  tell.  To  a  large  extent,  this  research,  like  factor-analytic  research, 
will  be  successful  to  the  degree  that  it  stimulates  the  level  of  theorizing  that 
will  eventually  subsume  it  as  a  special  case. 
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Footnotes 

This  research  was  supported  by  Contract  N0301473C0025  from  the  Office  of 
Naval  Research  to  Robert  J.  Sternberg.  We  are  grateful  to  aenbers  of  Robert 
Sternberg's  research  group  at  Yale  for  valuable  comments  on  an  earlier  version 
of  the  manuscript.  Portions  of  this  paper  were  presented  at  the  annual  meeting 
of  the  Society  for  Mathematical  Psychology,  Providence,  August,  1979.  Requests 
for  reprints  should  be  addressed  to  Robert  J.  Sternberg,  Department  of  Psychology, 
Yale  University,  Box  llA  Yale  Station,  New  Haven,  Connecticut  06520. 

^We  are  grateful  to  Adele  Abrahamson  for  supplying  the  analogies  used  in 
Experiment  1  of  Rumelhart  and  Abrahamson  (1973).  The  analogies  were  formed  from 
Henley's  (1969)  scaling  of  30  mammal  names  in  a  three-dimensional  space.  This 
multidimensional  scaling  resulted  in  three  interpretable  dimensions— site,  ferocity, 
and  humanness — and  Euclidean  distances  within  the  space  were  computed  on  the  basis 

t 

of  distances  between  coordinates  on  these  three  dimensions. 

^The  "correct"  rank  order,  based  upon  distance  from  the  ideal  point,  is 
I.  MONKEY,  2.  RACCOON,  3.  LEOPARD,  4.  CAMEL. 

*The  "correct"  rank  order  is  1.  RACCOON,  2.  DOG,  3.  HORSE,  4.  CAMEL. 

^The  "correct"  rank  order  is  1.  DEER,  2.  COW,  3.  DOG,  4.  MOUSE. 

^The  comparison  component  did  not  appear  in  the  theory  of  analogical  reasoning 
as  originally  presented  (Sternberg,  1977a,  1977b).  The  model  separating  comparison 
from  application  was  tested  in  one  experiment  (Sternberg,  1977b,  Chapter  7),  but 
was  found  not  to  perform  as  well  as  the  model  in  which  this  separation  did  not  occur. 
Hence,  the  model  with  the  additional  parameter  was  rejected.  Nhitely  and  Barnes 
(1979)  have  recently  suggested  that  the  separation  should  have  been  maintained. 

The  present  data  are  consistent  with  their  data  in  suggesting  the  utility  of  the 
separation,  and  hence  it  is  now  introduced  into  the  model,  as  suggested  by  Whitely 
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and  Barnes,  who  refer  to  the  component  as  "confimation." 

Sre  initially  performed  modeling  on  both  sets  of  data,  but  because  the  only 
differences  that  were  obtained  were  minor  and  seemingly  due  to  the  lessened  relia¬ 
bility  of  the  "corrects  only"  data  set  (from  which  error  latencies  had  been  removed), 
we  discontinued  this  duplication  of  effort. 

^In  order  for  the  expectation  of  the  parameter  estimates  to  be  the  same  in 
all  three  tasks,  it  is  also  necessary  that  the  same  content  and  representation 
of  information  apply  across  tasks.  The  content  obviously  was  the  same.  There  is 
some  evidence  of  possible  minor  differences  in  representations  (as  discussed  in 
the  General  Discussion  of  the  paper) . 

D 

By  "semantic  field,"  we  mean  a  set  of  terms  that  all  fall  into  a  single, 
clearly  definable,  semantic  category,  such  as  mammal  names,  bird  names,  presidents 
of  the  United  States,  brand  names  of  automobiles,  etc. 
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Table  1 

Subjects'  Rankings  as  a  Function  of  Alternative  Distance  and  Task 
Rank  distance  Subject-assigned  ranks  Task 


of  the  Alter¬ 
native  from  I 

\  1 

2 

3 

U 

1 

.180 

.069 

.01*6 

Bumelhart  and 

2 

Bug 

.5b6 

.137 

.129 

Abrahamson ' s 
Analogies 

3 

.160 

.526 

.226 

U 

.111 

CM 

• 

.600 

1 

2 

3 

1* 

1 

.659 

.201* 

.089 

.0U8 

Analogies 

2 

.211 

.521 

.139 

.129 

3 

.080 

.11*9 

.51*3 

.228 

U 

.050 

.126 

.229 

.596 

1 

2 

3 

U 

1 

.666 

.181 

.076 

• 

0 

V/l 

GO 

Series 

2 

.221 

.556 

.161 

.062 

Problems 

3 

.050 

.181 

.527 

.21*2 

k 

.0l»3 

.082 

.237 

.638 

1 

2 

3 

k 

■ 

1 

.599 

.268 

.091* 

.039 

Classifications 

2 

.28U 

.U78 

.177 

.061 

3 

.091 

.186 

.508 

.216 

k 

.026 

.069 

.221 

.681* 

Hote:  Tabled  values  represent  proportions  of  subjects  assigning  each  rank 
to  each  answer  option.  Each  proportion  is  based  upon  900  observations 

(30  subjects  X  30  items). 


Unities  in  Inductive  Reasoning 
41 


Table  2 

Mean  Solution  Latencies  and  Error  Rates  for  Each  Condition  of  Precueing 


Response  Latencies 

All  Items 


Items  Correctly 
Answered 


Item  Type 

Uncued 

Cued 

Uncued 

Cued 

Analogies 

8. SI 

6.06 

8.28 

5.9S 

Series  Completions 

7.08 

s.os 

6.74 

4.99 

Classifications 

6.6S 

4.29 

6.4S 

4.05 

Error  Rates 

Item  Type 

Uncued 

Cued 

Analogies 

.23 

.22 

Series  Completions 

.26 

.24 

Classifications 

.18 

.18 

Note:  Response  latencies  are  expressed  in  seconds 
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Table  3 

Paraaeter  Estioates  for  Each  Information-Processing  Component  in  Each  Task 


Parameter 

Task 

Parameter  Estimate 

Analogies 

1.22 

Encoding 

Series  Completions 

1.00 

Classifications 

.79 

Analogies 

.13 

Comparison 

Series  Completions 

.14 

Classifications 

.14 

Analogies 

• 

.36 

Justification 

Series  Completions 

;i8 

Classifications 

.24 

Analogies 

1.36 

Response^* 

Series  Completions 

3.36 

Classifications 

2.93 

Note:  Parameter  estimates,  expressed  in  seconds,  are  unstandardized  linear 

regression  coefficients.  Comparison  was  estimated  as  a  "time  savings" 
for  greater  distance,  but  is  expressed  here  in  unsigned  form.  All 
coefficients  are  statistically  significant  at  the  S%  level  or  better. 

*The  estimation  of  this  parameter  includes  the  response  component  latency  plus 
any  other  latency  constant  across  all  item  types. 
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Figure  Captions 

Figure  1.  Schematic  diagrams  showing  rules  for  arriving  at  ideal  point,  I,  in 
each  of  three  induction  tasks.  In  analogies,  I  is  located  as  the  fourth  vertex 
in  a  parallelogram  having  A,  B,  and  C  as  three  given  vertices.  In  series  com¬ 
pletions,  £  is  located  as  the  completion  of  a  line  segment  that  is  at  the  same 
vector  distance  from  S  that  B  is  from  A.  In  classifications,  ^  is  the  centroid 
of  the  triangle  with  A,  £,  and  £  as  vertices.  The  rules  can  be  extended  to  n^ 
dimensions  by  assuming  n-dimensional  analogues  to  the  two-dimensional  figures 
depicted.  In  each  type  of  problem,  four  answer  options  are  presented  at  suc¬ 
cessively  greater  Euclidean  distances  from  the  ideal  point. 

Figure  2.  Predicted  versus  observed  proportions  of  subjects  ranking  each 
of  the  four  answer  options  as  first,  second,  third,  and  fourth  choice.  Columns 
1,  2,  3,  and  4  correspond  to  the  first-,  second-,  third-,  and  fourth-choice 
data,  respectively.  Panel  A  is  for  Rumelhart  and  Abrahamson’s  (1973) ’analogy 
data;  panel  B  is  for  the  analogy  data  in  the  current  experiment;  panel  C  is  for 
the  series  completion  data  in  the  present  experiment;  panel  D  is  for  the 
classification  data  in  the  present  experiment.  The  abscissa  of  each  graph  is 
the  rank  distance  of  each  answer  option  from  the  ideal  point;  the  ordinate  is 
the  proportion  of  subjects  choosing  each  option.  Predicted  data  are  represented 
by  solid  lines,  and  observed  data  are  represented  by  broken  lines. 
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Maxwell  AFB 
Montgomery,  AL  36112 


t 


Marines 


CoastCuard 


H.  Williatn  Greenup 
Education  Advisor  (E031) 
Education  Center,  MCDEC 
Quantico,  VA  2213*t 

DR.  A.L.  SUFKOSKY 
ECIEtlTIFIC  ADVISCR  (CODE  RD-I ) 
KQ,  U.S.  CCF.FS 

WASHIt.’GTOfJ,  DC  20330 


1  Mr.  Richard  Lanterman 
PSYCHOLOGICAL  RESEARCH 
U.S.  COAST  GUARD  HQ 
WASHINGTON,  DC  20590 

1  Dr .  Thomas  Warm 

U.  5.  Coast  Guard  Institute 
P.  C.  Substation  13 
Oklahoma  City,  OK  73169 


Yale/Sternberg  October  U,  1979 


Page  7 


Other  DoD 


Civil  Govt 


1  Dr.  Stephen  Andriole 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
IKOO  WILSON  BLVD. 

ARLINGTON,  VA  22209 

.  12  Defense  Docunentation  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  22314 
Attn;  TC 

1  Dr.  Dexter  Fletcher 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
1400  WILSON  BLVD. 

ARLINGTON,  VA  222C9 


1  MAJOR  ’Wayne  Sellman,  USAF 

Office  of  the  Assistant  Secretary 
of  Defense  (KRAAL) 

3B930  The  Pentagon 
Washington,  DC  20301 


1  Dr.  Susan  Chipnan 
Basic  Skills  Program 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1  Dr.  William  Gorham,  Director 
Personnel  RAD  Center 
Office  of  Personnel  Kanagment 
1900  E  Street  N\^ 

Washington,  DC  20415 

1  Dr.  Joseph  I.  Lipson 

Division  of  Science  Education 
Room  V/-638 

National  Science  Foundation 
Washington,  DC  20550 

Dr.  Joseph  K.arkowitz 
Office  of  Research  and  Development 
Central  Intelligence  Agency 
;.’3Shington ,  DC  2C205 

Dr.  John  Mays 

National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20203 

1  Dr.  Arthur  Helmed 

National  Intitute  of  Education 
1200  19th  Street 
Washington,  DC  20206 


1  Dr.  William  Graham 
Testing  Directorate 
HEPCai 

Ft.  Sheridan,  IL  60037  1 

1  Military  Assistant  for  Training  and 
Personnel  Technology 

Office  of  the  Under  Secretary  of  Defense 
for  Research  A  Engineering  1 

Room  3D  129,  The  Pentagon 
Washington,  DC  20301 


1  Dr.  Andrew  R.  Holnar 
Science  Education  Dev. 
and  Research 

National  Science  Foundation 
Washington,  DC  20550 

1  Dr.  Jeffrey  Schiller 

National  Institute  of  Education 
1200  19th  St.  NW 
'Washington,  DC  20208 


> 
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Civil  Govt  Non  Govt 


1  Dr.  H.  Wallace  Sinaiko  1  Dr.  Carl  A.  Alluisi 

Program  Director  HQ,  AFHRL  (AFSC) 

Manpower  Research  and  Advisory  Services  Brooks  AFB,  TX  78235 


Smithsonian  Institution 
801  North  Pitt  Street 
Alexandria,  VA  2231^ 

1  Dr.  Thomas  G.  Sticht 
Basic  Skills  Program 
National  Institute  of  Education 
1200  19th  Street  NW 
V/ashington,  DC  20208 

1  Dr.  Frank  Withrow 

U.  S.  Office  of  Education 
MCO  6th  Street  SW 
Washington,  DC  20202 

1  Dr.  Joseph  L.  Yeung,  Director 
Memory  i  Cognitive  Processes 
national  Science  Foundation 
Washington,  DC  20550 


1  Dr.  John  R.  Anderson 

Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1  Dr .  John  Annett 

Department  of  Psychology 
University  of  Warwick 
Coventry  CVA  7AL 
ENGLAND 

1  DP.  MICHAEL  ATWOOD 

SCIEh’CE  APPLICATIONS  INSTITUTE 
MO  DENVER  TECH.  CENTER  WEST 
7935  E.  PREl.’TICE  AVENUE 
ENGLEWCOD,  CO  30110 

1  1  psychological  research  unit 

Dept,  of  Defense  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600,  Australia 

1  Dr.  Alan  Baddeley 

Medical  Research  Council 

Applied  Psychology  Unit 
15  Chaucer  Road 
Cambridge  CB2  2EF 
ENGLAND 

1  Dr.  Patricia  Baggett 

Department  of  Psychology 
University  of  Denver 
University  Park 
Denver,  CO  80208 

1  Dr.  Jackson  Beatty 

Department  of  Psychology 
University  of  California 
Los  Angeles,  CA  90024 

1  Dr .  Isaac  Bejar 

Educational  Testing  Service 
Princeton,  NJ  08450 
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Non  Govt 


Non  Govt 


1  Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
600  Jay  Street 
■Sacramento,  CA  95819 

1  Dr.  Lyle  Bourne 

Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80302 

1  Dr.  Robert  Brennan 

American  College  Testing  Programs 

P.  0.  Box  168 

Iowa  City.  lA  52240 

1  Dr.  John  S.  Brown 

XEROX  Palo  Alto  Research  Center 
3333  Coyote  Road 
Pclo  Alto,  CA  94304 

1  DR.  C.  VICTOR  BUNDERSON 
L'lCAT  INC. 

ur:i\'re.TiTy  pinzA,  suite  10 

TT/TE  ST. 

■  ■  ,  17  74C57 

1  Dr.  John  E.  Carroll 
Psychometric  Lab 
Univ.  of  No.  Carolina 
Davie  Hall  01 3A 
Chapel  Hill,  KC  27514 

1  Dr.  Villiam  Chase 

Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1  Dr.  Hicheline  Chi 

Learning  R  &  D  Center 
University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

1  Dr.  John  Chiorini 
Litton-Hellonies 
Box  1266 

Springfield,  VA  22151 


1  Dr.  Kenneth  E.  Clark 

College  of  Arts  &  Sciences 
University  of  Rochester 
River  Campus  Station 
Rochester,  NY  14627 

1  Dr.  Norman  Cliff 
Dept,  of  Psychology 
Univ.  of  So.  California 
University  Park 
Los  Angeles,  CA  90007 

1  Dr.  Allan  M.  Collins 

Bolt  Deranek  &  Newnan,  Inc. 

50  Moulton  Street 
Cambridge,  Ma  02138 

1  Dr.  Meredith  Crawford 

Departmmt  of  Engineering  Administration 
George  Uashingtor,  University 
Suite  3C5 

2101  L  Street  N.  W. 

Washington,  DC  20037 

1  Dr.  Ruth  Day 

Center  for  Advanced  Study 
in  Beiiovioral  Sciences 
202  Junipero  Serra  Blvd. 

Stanford,  CA  94305 

1  Dr .  Einmanuel  Donchin 

Department  of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 

1  Dr.  Hubert  Dreyfus 

Department  of  Philosophy 
University  of  California 
Berkely,  CA  94720 

1  Dr.  Marvin  D.  Dunnette 
N492  Elliott  Hall 
Dept,  of  Psychology 
Univ.  of  Minnesota 
Minneapolis,  MN  55455 
I 

1  ERIC  Facility-Acquisitions 
4833  Rugby  Avenue 
Bethesda,  MD  20014 
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Non  Govt 


Non  Govt 


1  MAJOR  I.  N.  EVONIC 

CANADIAN  FORCES  PERS.  APPLIED  RESEARCH 
1107  AVENUE  ROAD 
TORONTO.  ONTARIO.  CANADA 


Dr.  Ira  Goldstein 

XEROX  Palo  Alto  Research  Center 

3333  Coyote  Road 

Palo  Al^.  CA  9‘»30‘» 


1  Dr.  Ed  Feigenbaum 

Departnent  of  Computer  Science 
Stanford  University 
Stanford,  CA  9‘»305 

1  Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 

P.O.  Box  168 

Iowa  City,  lA  522H0 

1  Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville ,  MD  20850 

1  Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organ. 
Suite  900 

*•330  East  West  Highway 
Washington,  DC  20014 


1  DR.  JAMES  C.  GREENO 
LRDC 

UrilVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1  Dr .  Ron  Harableton 
School  of  Education 
University  of  Kassechusetts 
Amherst,  MA  01002 

1  Dr.  Harold  Hawkins 

Department  of  Psychology 
University  of  Oregon 
Eugene  OR  97403 

1  Dr.  Barbara  Kayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  90406 


1  Dr.  John  R.  Frederiksen 
Bolt  Beranek  A  Newnan 
50  Moulton  Street 
Cambridge,  HA  02138 

1  Dr.  Alinda  Friedman 

Department  of  Psychology 
University  of  Alberta 
Edmonton,  Alberta 
CANADA  T6G  2J9 

1  Dr .  R.  Edward  Geiselman 
Department  of  Psychology 
University  of  California 
Los  Angeles,  CA  90024 

1  DR.  ROBERT  GUSER 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 


1  Dr.  Frederick  Hayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  90406 

1  Dr.  James  R.  Hoffman 

Department  of  Psychology 
University  of  Delaware 
Newark,  DE  19711 

1  Dr .  Lloyd  Humphreys 

Department  of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 

1  Library 

Hum RRO/ We stern  Division 
27857  Berwick  Drive 
Camel ,  CA  93921 
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Non  Govt 


Non  Govt 


1  Dr .  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  93105 

1  Hr.  Gary  Irving 

Data  Sciences  Division 
Technology  Services  Corporation 
.  2311  Wilshire  Elvd. 

Santa  Honica  CA  9OAO3 

1  Dr.  Steven  W.  Keele 
Dept,  of  Psychology 
University  of  Oregon 
Eugene,  OR  97'I03 

1  Dr.  V^alter  Kintsch 

Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80302 

1  Dr.  David  Kieras 

Department  of  Psychology 
University  of  Arizona 
Tuscon,  AZ  £5721 

1  Dr.  Stephen  Kosslyn 
Harvard  University 
Department  of  Psychology 
33  Kiricland  Street 
Cambridge,  HA  02138 

1  Mr.  Marlin  Kroger 
1117  Via  Goleta 

Palos  Verdes  Estates,  CA  9027*1 

1  LCOL.  C.F.J.  LAFLEUR 
PERSONNEL  APPLIED  RESEARCH 
NATIONAL  DEFENSE  HQS 
101  COLONEL  BY  DRIVE 
OTTAWA,  CANADA  K1A  0K2 

1  Dr.  Jill  Larkin 

Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 


1  Dr.  Alan  Lesgold 
Learning  R&D  Center 
University  of  Pittsburgh 
Pittsburgh,  PA  15260 

1  Dr.  Robert  Linn 

College  of  Education 
University  of  Illinois 
Urbana,  IL  61801 

1  Dr.  Frederick  M.  Lord 

Educational  Testing  Service 
Princeton,  NJ  085**0 

1  Dr.  Richard  B.  Millward 
Dept,  of  Psychology 
Hunter  Lab. 

Drown  University 
Providence,  RI  82912 

1  Dr.  Allen  Munro 

Univ.  of  So.  California 
Behavioral  Technology  Labs 
3717  South  Hope  Street 
Los  Angeles,  CA  90007 

1  Dr.  Donald  A  Norman 

Dept,  of  Psychology  C-009 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  Dr.  Melvin  R.  Novick 
Iowa  Testing  Programs 
University  of  Iowa 
Iowa  City,  lA  522A2 

1  .  Dr.  Jesse  Orlansky 

Institute  for  Defense  Analysis 
*)00  Army  Navy  Drive 
Arlington,  VA  22202 

1  Dr.  Robert  Pachella 

Departtnent  of  Psychology 
Human  Performance  Center 
330  Packard  Road 
Ann  Arbyr,  MI  4810*1 
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Non  Govt 


1  Dr.  Seymour  A.  Papert 

Ilassachusetts  Institute  of  Technology 
Artificial  Intelligence  Lab 
S'IS  Technology  Square 
Cambridge,  KA  02139 

1  Dr.  James  A.  Paulson 

Portland  State  University 
P.O.  Box  751 
Portland,  OR  97207 

1  MR.  LUIGI  PETRULLO 

Pi131  N.  EDGEWCOD  STREET 
ARLINGTO!.',  VA  22207 

1  DR.  STEVEN  H.  PINE 
4950  Douglas  Avenue 
Golden  Valley,  MN  55416 

1  Dr.  Martha  Poison 

Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80302 

1  DR.  PETER  POLSON 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  COLORADO 
BOULDER,  CO  80302 

1  DR.  DIANE  M.  RAMSEY-KLEE 

R-K  RESEARCH  i  SYSTEM  DESIGN 
3947  RIDGEMONT  DRIVE 
MALIBU,  CA  90265 

1  MIN.  RET.  H.  RAUCH 
P  II  4 

BUNDESMINISTERIUM  DER  VERTEIDIGUNG 
POSTFACH  161 
53  BONN  1,  GERMANY 

1  Dr.  Peter  B.  Read 

Social  Science  Research  Council 
605  Third  Avenue 
New  York,  NY  10016 


Non  Govt 


1  Dr.  Mark  D.  Reckase 

Educational  Psychology  Dept. 

University  of  Missouri-Colianbia 
12  Hill, Hall 
Columbia .  MO  65201 

1  Dr.  Fred  Re  if 
SESAME 

c/o  Physics  Department 
University  of  California 
Berkely,  CA  94720 

1  Dr .  Andrew  K.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  IM 
Washington,  DC  20007 

1  Dr.  Leonard  L.  Rosenbaum,  Qiairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1  Dr.  Ernst  Z.  Rothkopf 
Bell  Laboratories 
60C  Mountain  Avenue 
Hurray  Kill,  NJ  07974 

1  Dr.  David  Rumelhart 

Center  for  Human  Information  Processing 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  PRCr.  FUMIKO  SMIEJIMA 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  TENNESSEE 
KNOXVILLE,  TN  37916 

1  Dr.  Irwin  Sarason 

Department  of  Psychology 
University  of  Washington 
Seattle.  WA  98195 

1  DR.  WALTER  SCHNEIDER 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  ILLINOIS 
CHAMPAIGN,  IL  61820 
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Mon  Govt 


1  Dr.  Richard  Snow 
School  of  Education 
Stanford  University 
Ctanford,  CA  9^305 

,  1  DH.  ALBERT  STEVENS 

BOLT  BERANEK  &  HE\J!1AK,  INC. 

50  nOULTON  STREET 

,  CAMBRIDGE,  UA  02138 

1  DR.  PATRICK  SUPPES 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD.  CA  9^305 

1  Dr.  Hariharan  Swaninathan 

Laboratory  of  Psychometric  and 
Evaluation  Research 
School  of  Education 
University  of  r.assachu5etts 
Amherst,  KA  OIOO3 

1  Dr .  Brad  Sympson 

Office  of  Data  Analysis  Research 
Educational  Testing  Service 
Princeton,  NJ  035*11 

1  Dr.  Kikvzni  Tatsuoka 

Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

1  Dr.  David  Thissen 

Department  of  Psychology 
University  of  Kansas 
Lawrence,  KS  660*1*) 

1  Dr.  John  Thomas 

'  IBM  Tliomas  J.  Watson  Research  Center 
P.O.  Box  218 

Yorktown  Heights,  NY  10598 

1  DR.  PERRY  TKORNDYKE 
THE  RAND  CORPORATION 
1700  MAIN  STREET 
SANTA  HOMICA,  CA  90006 


Non  Govt 


1  Dr.  J.  Uhlaner 

Perceptronics,  Inc. 

6271  Variel  Avenue 
Woodland  Hills,  CA  91360 

1  Dr.  Benton  J.  Underwood 
Dept,  of  Psychology 
Northwestern  University 
Evanston,  IL  60201 

1  Dr.  Howard  Walner 

Bureau  of  Social  Science  Research 
1990  M  Street,  N.  W. 

Washington,  DC  20036 

1  Dr.  Phyllis  Weaver 

Graduate  School  of  Education 
Harvard  University 
200  Larsen  Hall,  Appian  Way 
Cambridge,  flA  02138 

1  Dr.  David  J.  Weiss 
K660  Elliott  Hall 
University  of  Minnesota 
75  E.  River  Road 
Minneapolis,  MH  55*155 

1  DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
LAWRENCE,  KANSAS  660*1*) 

1  Dr.  J.  Arthur  Woodward 
Department  of  Psychology 
University  of  California 
Los  Angeles,  CA  9002*1 

1  Dr.  Karl  Zlnn 

Center  for  research  on  Learning 
and  Teaching 
University  of  Michigan 
Ann  Arbor,  HI  *1810*1 
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